Is there a way to get a list of urls on the website?
-
For example, www.laskeimages.com
Outside of Google Search Console, is there another way?
-
You can run a "site:yourwebsite.com" search on google and see what is returned. Based on the results you can run further "site:" searches along with more parameters to see more URLs in the index.
A general "site:yourwebsite.com" idea about how many pages are in the index, but it's not 100% accurate.
-
slickplan.com allows you to pull the entire sitemap of your site and pull links, descriptions etc
-
If all of the pages you are interested in are linked internally from somewhere in your site which can be reached through navigation or page links, you can run a simulated crawl with a tool like ScreamingFrog, whcih will discover all the "discoverable" pages.
The site you referenced is built with a platform called "Good Gallery", whcih generates a sitemap. This is at www.laskeimages.com/sitemap.xml. I'm not sure what criteria it might use to include/exclude pages, but that would likely be a good list. You will need to view the page source of that page to see the data in a structured way to extract it.
Another method is to use Google Analytics. Assuming that each page of your site has been viewed at least once in its history, you could extract the list from Google Analytics. Especially from an unfiltered view which includes visits by bots.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Website Domain Redirection- Rebranding Issues
I have a website domain redirection query At the moment because of rebranding and domain changes I havehttp://www.physioinqnepean.com.au redirecting to http://www.nepeanphysiohydro.com.au/.http://www.nepeanphysiohydro.com.au/ is the primary domain because at the time I wanted to appease any SEO ramifications that might’ve occurred if I had the new domain at the time “http://www.physioinqnepean.com.au” as the primary domain.Unfortunately, my client now wants to rebrand AGAIN with the new website domain being “http://www.physioinqpenrith.com.au”.I wanted to gauge what would be the best SEO practice in relation to what domain should be the “Primary domain"?
Local SEO | | JD261 -
How to get listed for specific locations/cities/towns
Best practice?? I have a client that wishes to get found for services in several towns across the UK. They only have 1 physical location I have so far created a blog ( i use easyblog) and put a list of these towns..then added TAGS with the town names (this means each TAG gets a URL too) ..also i need to then monitor in moz pro somehow. Alternatively i could create web pages with additional information and give the URL the town name....however i think the tags will help...any advice welcome.
Local SEO | | CORSOLUTIONS1 -
Should you set an hreflang if the website is only in one language
We have a website, which is written in British English. There are no other versions of the site in different languages and the website only serves a UK audience. We have not set an hreflang tag up. Is this something we would still need to do and what would the benefits (if any) be?
Local SEO | | HubMDP0 -
Should I Split Into Two Websites?
I'm creating a website for a new company that offers several related services. They want to have a main corporate website that has pages for all their services. However, they want to have a second website that only features a subset of those services. So they would have the same company name, same website template, but the smaller site would have a different domain name, different text/photos on the home page and be missing some pages from the main corporate site so that site would make them look more specialized. They would have separate marketing materials (brochures, business cards) that would have the website address and email address using the different domain name. They also want the smaller second site to come up on search results related to the services for that site and not the main site. Can this be pulled off without having a significant negative effect on ranking potential for either of the two site and also not risk a duplicate content penalty? It would seem you would have to add a robots.txt file that excludes indexing of the pages on the main site that are duplicating on the smaller site. However there is a potential big issue. The company is a local business. Nowadays the local results (Map + 3-pack) are as important if not more important, than the traditional organic results below the 3-pack (although I acknowledge they are related). For their Google Business Places, since they have two websites for the same company, they can only list one of the website. So if they list the corporate site, their not going to get in the local 3-pack for their specialized site for search terms. They may be able to live with this though since the main site will show ALL services. Comments? Ideas? Issues? Strategies?
Local SEO | | DJ10270 -
If I kill off the franchisee websites and create a corp SEO monster...will my Company's SEO suffer? Pros and Cons?
Our 25 franchisees sell one product of our 7 within the Corporate porfolio. We getting ready to release a brand new corp website employing all the best possible SEO practices. Since the franchisee's barely maintain their 3-page website...we are thinking of killing them off. We will create some market pages on the Corp side and continue to use HubSpot to pass along leads to the individual franchisees. Corporate has robust Content Marketing strategy in place. Any suggestions? Cases studies?
Local SEO | | Joseph.Lusso0 -
Suggestion "How can I improve my website"
Hi Folks , I'm trying to help my friend , I need your suggestion. I gathered all the data , Please find the attachment , our spam score is 5 as compared with competitors 0 root domain 0 total links 1.)How can we increase the page authority ? 2.)Should i buy more backlinks ? Which website you will recommend me ? 3.) How can i reduce my spam score to 0 or 1 ? I'm not sure about the links which are attached to my website? However, I read in moz article it could be because large domain and few links. It doesn't show any thing on open site explorer. It looks like we haven't discovered link data for this site or URL. We are running google ads , Facebooks ads and twitter. MpYq1
Local SEO | | hemantt0 -
What is The Best Way to Rank in Multiple Countries?
Hi, I have a client that would like to rank in google.ie as well as .co.uk and in the middle east and possibly other parts of Europe. What is the best way to go about this? Would a new domain for each country be best and hosted in that specific country or is there a way to do this with one site? Bearing in mind that SEO will need to be done to rank in each country. Many Thanks.
Local SEO | | WSIDW0 -
How to get links for boring niches/industries?
I've asked this question before, but it's 12/18 months on, the SEO landscape has changed, and new people are aboard. So basically, how do others look/achieve links for industries that generally have static sites with little to report. My books are awash with forklift truck, accountants, concrete companies. Very little happens in their businesses - someone orders concrete... my client delivers concrete. Someone orders a forklift.... my client sends a forklift..... Yes, we can do a bit of social, but where else would people go for link building. If my client was a wedding photographer, a mountain climber or cancer specialist, I'd be rolling in ideas, as it is, I find myself a little stumped sometimes.
Local SEO | | Gordon_Hall0