Moz Q&A is closed.
After more than 13 years, and tens of thousands of questions, Moz Q&A closed on 12th December 2024. Whilst we’re not completely removing the content - many posts will still be possible to view - we have locked both new posts and new replies. More details here.
Is there a way to get a list of urls on the website?
-
For example, www.laskeimages.com
Outside of Google Search Console, is there another way?
-
You can run a "site:yourwebsite.com" search on google and see what is returned. Based on the results you can run further "site:" searches along with more parameters to see more URLs in the index.
A general "site:yourwebsite.com" idea about how many pages are in the index, but it's not 100% accurate.
-
slickplan.com allows you to pull the entire sitemap of your site and pull links, descriptions etc
-
If all of the pages you are interested in are linked internally from somewhere in your site which can be reached through navigation or page links, you can run a simulated crawl with a tool like ScreamingFrog, whcih will discover all the "discoverable" pages.
The site you referenced is built with a platform called "Good Gallery", whcih generates a sitemap. This is at www.laskeimages.com/sitemap.xml. I'm not sure what criteria it might use to include/exclude pages, but that would likely be a good list. You will need to view the page source of that page to see the data in a structured way to extract it.
Another method is to use Google Analytics. Assuming that each page of your site has been viewed at least once in its history, you could extract the list from Google Analytics. Especially from an unfiltered view which includes visits by bots.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Are These Urls for Targeted Cities OK?
I am working for a waterproofing company out of long beach that wants to rank for other neighborhoods around the area. But I just noticed that their URLs are targeting two locations. They have the cities built on the URLs after the long beach part. Will that affect rankings? Not be as potent as a truly SEO friendly url like example.com/services/mold-remediation/mold-remediation-brooklyn-ny? Here is an example: https://zavzaseal.com/mold-remediation-service-provider-long-island-ny/mold-removal-pro-in-copiague-ny-11726/ Another thing is the URLs say "mold removal pro" if I am targeting "mold removal copiague, NY" will that matter to rankings that the URL has pro in it?
Local SEO | | ThisTimeWereOn0 -
How to speed a website which government demands a popup of age restriction to display
Hi team, Im running a website, which is related to Online Vape shop and I have some confusion regarding the core web vital algorithm. However, the Government of the USA is very strict for this kind of topic and we should have to display the age restriction popup for those new users who enter the website: https://ashvapesmoke.com/ Can anyone tell me how to speed up the website, as if the website has this kind of popup mandatory guidelines from the government. Google is launching a new core update related to speed in the may 2021 right? So if we add this kind of banner popup and all In the website, how we can get away from the issues. Please clarify to me, anyone, ASAP.
Local SEO | | hopseq0 -
Should you set an hreflang if the website is only in one language
We have a website, which is written in British English. There are no other versions of the site in different languages and the website only serves a UK audience. We have not set an hreflang tag up. Is this something we would still need to do and what would the benefits (if any) be?
Local SEO | | HubMDP0 -
One website or multiple websites
Im going round in circles with the best way to go about marketting my business from an SEO and usability stand point. My company specialise in self adhesive films and vinyls which give us quite a varied niche. Our main areas are: Window films and interior vinyls such as printed wallpaper, wall coverings, furniture wraps etc for homes and businesses - For this area we cover nationwide Automotive films such as car window tinting, car and van wraps and paint protection films - for this we need the vehicles bringing to us so this is a more local are (around 20 miles of us max) Signs and graphics - anything from office signs, pavement signs to printed banners - these are all commercial and we go to the customer. For this its a new side to the business and Id say wed look to go withing 50 miles of our base. My dilemma is, firstly when pushing social media etc we have a real divide for who we target as we have the home owers and business owners on one hand and then car enthusiasts on the other. Also from an SEO point of view theres the local vs nationwide aspect. A few people I have spoken to have said trying to target local for some services and national for others may be a little problematic. I have some people saying have all services under one domain as the links back to the site and content will all help the site to rank better. This sounds logical to me. But then Ive had other people saying split the site into 2/3 sites. Definitely split the automotive which is local from the other national areas as these are also going to be a different audience 9car enthusiasts vs home/business owners). It will mean doing two lots of SEO but the sites will be more focused on the target audience and we can have one tagret local search and the other national. This too seems very logical. My gut feeling is that both options are sort of right but doesn anyone have any advice that could help me figure this out. Also to make things a little more complicated we have an ecommerce side were we supply goods direct to the public. Woudl I be better to have a fresh domain which is simply an ecommerce platform or have a seperate shop section on my main domain were people can go to buy the products if they dont want us to fit them?
Local SEO | | paulfoz16091 -
Best way to advertise cosmetic dermatologist on Facebook in the UK?
I have a client who owns a cosmetic dermatology clinic. Recently he's been trying to work more on his Facebook page, and has been attempting to boost his posts but they keep getting declined for this, that and the other. "No before and after photos", "Ad is sensitive in nature", etc. Nothing shady, he's a registered doctor and a member of the Royal College of Physicians in London and the Royal College of General Practitioners. Main treatments offered are things like Botox (which I know he can't legally advertise due to strict advertising standards in the UK), dermal fillers, lip fillers, non-surgical lifts. Just general non-surgical prescription-level cosmetic treatments. I don't have much experience in Facebook advertising, but this line of work seems particularly challenging to advertise on Facebook. Does anyone who has experience in advertising this type of business on Facebook have any general advice on what sorts of posts/ads have worked with them before?
Local SEO | | Ria_2 -
Strategy for [list of keywords] + hundreds of cities
Hi, hoping to get some suggestions on strategy in terms of building out my site as I'm a bit overwhelmed. We provide home services throughout hundreds of locations - some major cities, others smaller yet affluent towns where demand is sufficient, though have no physical presence in the majority. My question is really regarding ranking organically (given local listings will be so difficult). I am new to Moz and have been using the Keyword Explorer to generate a long list of keywords, which I've refined to those which offer the most opportunity. Do I simply now take this list and append [city_name] to each keyword/phrase? If so, working in [list_of_keywords] + [city] into hundreds of location pages is surely going to be a nightmare to make unique, and most likely a horrible user experience. All my customers really want to see is: that we service their area, some info on how we operate, that we are trustworthy (reviews/site quality etc) clear pricing/information (across mobile/desktop) and an easy way of contacting us. If I was searching for a lawn care service in Manchester for example, I couldn't care less about anything else other than the above information. So is padding out pages with content like 'Things to do in Manchester' etc. really the way forward? Would I be better off focusing on building relationships/links with other local complimentary businesses/influencers rather than building out tons of content (on the assumption of course that what content is there is high quality, contains a smattering of keyword + city, and optimised very well)? Any help hugely appreciated!
Local SEO | | Cleanily1 -
Google cache is showing the wrong URL with CCTLD's
Hi Folks, At Lightspeed we decided to setup local websites with CCtld's. Momentarily we have issues with the Google cache. I'm not sure what's going wrong. For example if I check the Google cache of www.lightspeedhq.be in the Belgium Google it refers to www.lightspeedhq.nl. See link: https://webcache.googleusercontent.com/search?q=cache:fm0XIZ8sEe8J:https://www.lightspeedhq.be/+&cd=2&hl=nl&ct=clnk&gl=be We have the same problem for our www.lightspeedhq.co.uk website, which is referring to www.lightspeedhq.com: https://webcache.googleusercontent.com/search?q=cache:OXdAIIFa7AYJ:https://www.lightspeedhq.co.uk/+&cd=1&hl=en&ct=clnk&gl=uk Does Google sees it as duplicate content? Or don't we have to use 'Alternative Hreflang'? A week ago we changed our canonical links which were actually randomly referring from .be > .nl and .co.uk to .com. What can we do now to make sure all is properly indexed? Best, Ruud
Local SEO | | Ruudst0 -
2 websites or one .ca and .com
Hi I have a client with a lighting business in Canada but ship to all US- they have ecommerce web site .ca and .com the .ca has always brought more traffic. (they have a store in Canada) they are now redoing the site and trying to decide should they have just one site and the other redirected to it or should they have two and which one the main one- they would like to sell to the us but are obviously stronger in Canada- don't want to lose on both sides.. Appreciate any help!
Local SEO | | maryk920