Is there a way to get a list of urls on the website?
-
For example, www.laskeimages.com
Outside of Google Search Console, is there another way?
-
You can run a "site:yourwebsite.com" search on google and see what is returned. Based on the results you can run further "site:" searches along with more parameters to see more URLs in the index.
A general "site:yourwebsite.com" idea about how many pages are in the index, but it's not 100% accurate.
-
slickplan.com allows you to pull the entire sitemap of your site and pull links, descriptions etc
-
If all of the pages you are interested in are linked internally from somewhere in your site which can be reached through navigation or page links, you can run a simulated crawl with a tool like ScreamingFrog, whcih will discover all the "discoverable" pages.
The site you referenced is built with a platform called "Good Gallery", whcih generates a sitemap. This is at www.laskeimages.com/sitemap.xml. I'm not sure what criteria it might use to include/exclude pages, but that would likely be a good list. You will need to view the page source of that page to see the data in a structured way to extract it.
Another method is to use Google Analytics. Assuming that each page of your site has been viewed at least once in its history, you could extract the list from Google Analytics. Especially from an unfiltered view which includes visits by bots.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Rankings preferring English URL
We've recently had a redesign of our website and we have both a Dutch and an English version. However, in MOZ for both NL and BE-NL it seems to favor the English URLs. This never used to be the case and I'm wondering why it's happening and whether it could actually be hurting our SEO, as search engines would favor local languages for search queries.
Local SEO | | Billywig0 -
How to speed a website which government demands a popup of age restriction to display
Hi team, Im running a website, which is related to Online Vape shop and I have some confusion regarding the core web vital algorithm. However, the Government of the USA is very strict for this kind of topic and we should have to display the age restriction popup for those new users who enter the website: https://ashvapesmoke.com/ Can anyone tell me how to speed up the website, as if the website has this kind of popup mandatory guidelines from the government. Google is launching a new core update related to speed in the may 2021 right? So if we add this kind of banner popup and all In the website, how we can get away from the issues. Please clarify to me, anyone, ASAP.
Local SEO | | hopseq0 -
Building Press Release/News Distribution Lists
I'm currently setting up projects in Buzz Stream so that I can send out news tips and press releases to local news stations. Has anyone been able to do this successfully without signing up for an expensive press release distribution company like Newswire? If so... I would appreciate it if you could share an email template you use to send out your news tips and press releases to the local news stations. Thank you!!!
Local SEO | | LindsayE1 -
Should I Split Into Two Websites?
I'm creating a website for a new company that offers several related services. They want to have a main corporate website that has pages for all their services. However, they want to have a second website that only features a subset of those services. So they would have the same company name, same website template, but the smaller site would have a different domain name, different text/photos on the home page and be missing some pages from the main corporate site so that site would make them look more specialized. They would have separate marketing materials (brochures, business cards) that would have the website address and email address using the different domain name. They also want the smaller second site to come up on search results related to the services for that site and not the main site. Can this be pulled off without having a significant negative effect on ranking potential for either of the two site and also not risk a duplicate content penalty? It would seem you would have to add a robots.txt file that excludes indexing of the pages on the main site that are duplicating on the smaller site. However there is a potential big issue. The company is a local business. Nowadays the local results (Map + 3-pack) are as important if not more important, than the traditional organic results below the 3-pack (although I acknowledge they are related). For their Google Business Places, since they have two websites for the same company, they can only list one of the website. So if they list the corporate site, their not going to get in the local 3-pack for their specialized site for search terms. They may be able to live with this though since the main site will show ALL services. Comments? Ideas? Issues? Strategies?
Local SEO | | DJ10270 -
Ideas on competitors website jumping so quickly?
Aloha Moz community! I've been chipping away on my site and have been happy to see progress on getting to the first page for some searches I'd like to rank for. That being said and during my time doing this I noticed a fellow photographer jump to the first page out of what seems like nowhere! http://emilyhelen.com/ It left me scratching my head trying to figure out where and how they're site jumped up to the front so fast and has been holding strong since then. Do you guys have any ideas or ways I could replicate that? Much appreciated as always guys! Warmest aloha, Jon Gibb
Local SEO | | Trey30 -
Google cache is showing the wrong URL with CCTLD's
Hi Folks, At Lightspeed we decided to setup local websites with CCtld's. Momentarily we have issues with the Google cache. I'm not sure what's going wrong. For example if I check the Google cache of www.lightspeedhq.be in the Belgium Google it refers to www.lightspeedhq.nl. See link: https://webcache.googleusercontent.com/search?q=cache:fm0XIZ8sEe8J:https://www.lightspeedhq.be/+&cd=2&hl=nl&ct=clnk&gl=be We have the same problem for our www.lightspeedhq.co.uk website, which is referring to www.lightspeedhq.com: https://webcache.googleusercontent.com/search?q=cache:OXdAIIFa7AYJ:https://www.lightspeedhq.co.uk/+&cd=1&hl=en&ct=clnk&gl=uk Does Google sees it as duplicate content? Or don't we have to use 'Alternative Hreflang'? A week ago we changed our canonical links which were actually randomly referring from .be > .nl and .co.uk to .com. What can we do now to make sure all is properly indexed? Best, Ruud
Local SEO | | Ruudst0 -
Duplicate content across a number of websites.
We have a client who has approximately 25 retail sites (mini department stores) selling in general the same merchandise ranges - some stores carry all the ranges (brands) while others have fewer due to space restrictions. Each destination is different has its own branding and unique selling point which needs to be reflected. The client wants us to build individual websites for each location as they want to promote each location individually. I know that the search engines don't penalise duplicate content, but the core of each website is going to be essentially the same. My concern is there is no way you could write 25 different pages about the same Colony Candle range! Any ideas suggestions would be much appreciated - a one site option would not work as the client wants individual website and due to the different branding, USP and the fact they want to market them individually I would agree with them. Thanks Fraser
Local SEO | | fraserhannah0 -
How to find best local websites?
For example, I'd like to type in a zipcode and get the highest ranking websites by DA/whatever metric the software uses, within a 25 mile radius? Does that type of service exist? I'm looking to build up our local links, but most of the websites have extremely low authority. I'm trying to find some good ones without having to manually check each one. Thanks, Ruben
Local SEO | | KempRugeLawGroup1