Is there a way to get a list of urls on the website?
-
For example, www.laskeimages.com
Outside of Google Search Console, is there another way?
-
You can run a "site:yourwebsite.com" search on google and see what is returned. Based on the results you can run further "site:" searches along with more parameters to see more URLs in the index.
A general "site:yourwebsite.com" idea about how many pages are in the index, but it's not 100% accurate.
-
slickplan.com allows you to pull the entire sitemap of your site and pull links, descriptions etc
-
If all of the pages you are interested in are linked internally from somewhere in your site which can be reached through navigation or page links, you can run a simulated crawl with a tool like ScreamingFrog, whcih will discover all the "discoverable" pages.
The site you referenced is built with a platform called "Good Gallery", whcih generates a sitemap. This is at www.laskeimages.com/sitemap.xml. I'm not sure what criteria it might use to include/exclude pages, but that would likely be a good list. You will need to view the page source of that page to see the data in a structured way to extract it.
Another method is to use Google Analytics. Assuming that each page of your site has been viewed at least once in its history, you could extract the list from Google Analytics. Especially from an unfiltered view which includes visits by bots.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
What is the best structured data for my website
We have 10:branches for our agency where we are looking to attract local businesses to use our marketing services, should each landing page have structured data for ‘local business’? Any advice would be helpful
Local SEO | | Caffeine_Marketing0 -
We're merging 2 separate websites into 1 but need to ideally rank service pages for both locations
I have a dilemma, we're merging 2 websites, one an Australian branch and one a UK one. We've decided to have a UK page and a AUS page so agency.site/uk/ agency.site/aus/ but what is the best tactic for the service pages? ideally, we'd like a web-design service page to rank in Australia and the UK but not sure if this is actually possible, or whether to duplicate the pages and localise them i.e. /web-design-leeds/ and /web-design-melbourne/ What's everyone's thoughts on this? localised landing pages with some duplicate content or one master page with both locations mentioned? Thanks!
Local SEO | | Unbranded_Lee1 -
Should you set an hreflang if the website is only in one language
We have a website, which is written in British English. There are no other versions of the site in different languages and the website only serves a UK audience. We have not set an hreflang tag up. Is this something we would still need to do and what would the benefits (if any) be?
Local SEO | | HubMDP0 -
Should I Split Into Two Websites?
I'm creating a website for a new company that offers several related services. They want to have a main corporate website that has pages for all their services. However, they want to have a second website that only features a subset of those services. So they would have the same company name, same website template, but the smaller site would have a different domain name, different text/photos on the home page and be missing some pages from the main corporate site so that site would make them look more specialized. They would have separate marketing materials (brochures, business cards) that would have the website address and email address using the different domain name. They also want the smaller second site to come up on search results related to the services for that site and not the main site. Can this be pulled off without having a significant negative effect on ranking potential for either of the two site and also not risk a duplicate content penalty? It would seem you would have to add a robots.txt file that excludes indexing of the pages on the main site that are duplicating on the smaller site. However there is a potential big issue. The company is a local business. Nowadays the local results (Map + 3-pack) are as important if not more important, than the traditional organic results below the 3-pack (although I acknowledge they are related). For their Google Business Places, since they have two websites for the same company, they can only list one of the website. So if they list the corporate site, their not going to get in the local 3-pack for their specialized site for search terms. They may be able to live with this though since the main site will show ALL services. Comments? Ideas? Issues? Strategies?
Local SEO | | DJ10270 -
Will a 301 alter URL structures?
Hi all, I'd like to re-direct page A to page B. The problem is, under page A, I have a number of other pages. So, for example - www.website.co.uk/A/fake/website If I re-direct www.website.co.uk/A/ to www.website.co.uk/B/, would the sub-pages then become unusable as a URL? Or would they stay intact because I'm not changing the location of the pages, merely applying a re-direct to the folder that it's in. Cheers, Rhys
Local SEO | | SwanseaMedicine0 -
SEO: Directory Listing Help with Two business locations in different states
Hello! I am in the process of building my second location, and will be moving to Nashville TN. My first location is located in ohio, and I am changing my primary location to nashville, but still want to keep my clients in Ohio... At least for the first year. As for directory building, what is the best option? 1.) Should I create two separate directory listings for each location and then direct www.domain.com to Nashville directory, and then www.domain.com/ohio-wedding-photographer/ to the Ohio listing in the directory? Or do you create one directory and mention I have offices in both Ohio and nashville? Is it bad to have two listings for each location if they have different addresses and phone numbers? Thank you!
Local SEO | | jean78780 -
2 websites or one .ca and .com
Hi I have a client with a lighting business in Canada but ship to all US- they have ecommerce web site .ca and .com the .ca has always brought more traffic. (they have a store in Canada) they are now redoing the site and trying to decide should they have just one site and the other redirected to it or should they have two and which one the main one- they would like to sell to the us but are obviously stronger in Canada- don't want to lose on both sides.. Appreciate any help!
Local SEO | | maryk920 -
Does having /search/ in your URLs for searches within your site hamper these URLs from coming up on Google SERP's?
We are an aggregate site for a particular category and have our own internal search wherein visitors can search for local references to services that they are looking for. We use SOLR search and our results page for the "Tag123" search would look like www.mywebsite.com/city/search/tag123 For some reason, we see that these pages are all indexed on Google but they do not come up on SERPs appropriately! The content is unique and we also have appropriate title and description tags on these pages.
Local SEO | | mycity4kids0