Is there a way to get a list of urls on the website?
-
For example, www.laskeimages.com
Outside of Google Search Console, is there another way?
-
You can run a "site:yourwebsite.com" search on google and see what is returned. Based on the results you can run further "site:" searches along with more parameters to see more URLs in the index.
A general "site:yourwebsite.com" idea about how many pages are in the index, but it's not 100% accurate.
-
slickplan.com allows you to pull the entire sitemap of your site and pull links, descriptions etc
-
If all of the pages you are interested in are linked internally from somewhere in your site which can be reached through navigation or page links, you can run a simulated crawl with a tool like ScreamingFrog, whcih will discover all the "discoverable" pages.
The site you referenced is built with a platform called "Good Gallery", whcih generates a sitemap. This is at www.laskeimages.com/sitemap.xml. I'm not sure what criteria it might use to include/exclude pages, but that would likely be a good list. You will need to view the page source of that page to see the data in a structured way to extract it.
Another method is to use Google Analytics. Assuming that each page of your site has been viewed at least once in its history, you could extract the list from Google Analytics. Especially from an unfiltered view which includes visits by bots.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
2 Websites Targeting Similar Keywords
One of my clients is set on setting up another website targeting some of the keywords/services on the main site. One of the services they offer gets traffic from natural search and also Adwords but doesn't convert well for this service. For other services (which are often utilized at the same time by the customers) the site converts well. My client feels that... "people are not converting on the main site because they click on the page and realise that we are a wider company. From this they probably work out that we don’t actually produce Green Widgets and we just buy them in. Therefore we will be more expensive than a company who does manufacture Green Widgets (although there are only a few in the country who actually make them)." The new site "...will have more of a manufacturer and specialist feel. There will be a small mention of other services. People visiting will think we are specialists and that we make them, whereas at the moment they may feel that they are just being cross sold a product. We have also noticed that we are not being found earlier enough and we are contacted to do other work only to find that another company is providing the Green Widgets." I did something similar back in the day, but here we ran a local website and a national website covering the same products. We tried hard not to duplicate the keywords we targeted minimising this as much as possible. I don't think we cared much about the local site as the national one went crazy busy. In essence, my client wants to do the following: Main Site...
Local SEO | | GrouchyKids
Blue Widgets Bristol
Red Widgets Bristol
Green Widgets Bristol (This would be retained) New Site...
The new site would focus on Green Widgets In time the new site would include content for...
Green Widgets
Green Widgets Bristol (As per the main site)
Green Widgets Cardiff It would also make mention of Blue Widgets and Red Widgets as possible addons. The new site would be at the same address but have its own companies house registration, emails and phone numbers. My feeling is that we should take an above-board, risk-free approach and remove the Green Widgets service from the main site to ensure it doesn't upset Google. In other words go out of our way to minimise targeting of similar/same keywords across the 2 sites. My client strongly disagrees showing evidence of others using similar tactics (we have had the EMD debate as well). I am also concerned about Google Places and how this might be viewed here. Opinions please, also any idea of what if any action Google would take if we push forwards?0 -
Two websites or a sub domain or sub page?
Hi, Our company has three branches in Canada and opening a 4th in the United States soon. Our target market strategy will differ in the States and I would like to know your opinion if we should launch a second site under a slightly different brand or not. I don’t want to do anything that could negatively impact our site’s current organic ranks. I feel I have to give some history on our company so you understand the dilemma. It is a little complicated. So, in Canada, we rent large generators and all the equipment needed to distribute and transform that power. We don’t own the generators. We re-rent generators (broker) from our partners. What we own is all the distribution equipment that typically accompanies a generator rental. We make money on the generator also, but the real money is in the distribution portion. In terms of messaging, our current site is tuned to target the end-user, the same market that our re-rent partners target. As a result, our re-rent partners and our company will bid on the same project in many occurrences. Our strategy in the United States is to primarily target the re-rent market. That is a very small segment in comparison to the end-user. From a marketing perspective, all that is really needed to target that group is an outside sales team. There are maybe 40 re-rent partners we will target in our first U.S. GEO… Texas. In the States, we will not rent generators. We will not run ad campaigns that bid on any generator rental type terms. We will not offer the same level of turn-key solutions we offer in Canada. All of the equipment we manufacture will be very generic in appearance, think Acme. Branding will look completely different than what we have up in Canada. We want the re-rent companies we target in the States to feel comfortable we are there to support them not compete against them. Regarding website strategy, I see three options: 1. We create a sub domain or sub page of www.trinitypower.com that explains the services we offer in the States. This for me is the safest solution. 2. We launch a second domain www.trinitypowerrentals.com that has similar content in-terms of the type of equipment we rent, but speaks directly to re-rent partners. That may not be enough of a differentiator though and I fear two sites owned by the same company with similar content will have negative SEO implications, if not right away, a year down the road. 3. We launch a new website under a completely different company name. This still carries some risk as I understand it, even if we have different phone numbers, company registration info, etc…
Local SEO | | TrinityPower
Would love to know your thoughts. Thanks everyone. J0 -
Building Press Release/News Distribution Lists
I'm currently setting up projects in Buzz Stream so that I can send out news tips and press releases to local news stations. Has anyone been able to do this successfully without signing up for an expensive press release distribution company like Newswire? If so... I would appreciate it if you could share an email template you use to send out your news tips and press releases to the local news stations. Thank you!!!
Local SEO | | LindsayE1 -
Should we get an Australian TLD?
We are launching a product in Australia which is already available in the UK. We currently have the .co.uk but the .com is not available. How important would it be to get the Australian TLD? I am interested in hearing from people who have knowledge of the Australian market to understand how they would feel about buying from a .co.uk. I know the US market wouldn't be keen to buy from a .co.uk, so would be interested to know if the same would be true of Australia. The product is a crafty mum to mum product, invented by a UK mum and that is part of the appeal, which may make the UK domain more palatable? The client has a small budget and low profit margins so creating a whole new website could be prohibitative. So I am keen to go down the route of a sub-directory targeting Australia if possible. Thanks in advance
Local SEO | | Wagada0 -
How to compete with business names and urls that include location?
I have several instances of competitor businesses that rank high in the local pack while I'm struggling to get in there at all. Here's a specific example: Keyword is "name-of-town chiropractor" and the competitor business name is "name-of-town chiropractic". Google doesn't seem to exclude "name-of-town" because these businesses don't rank the same if you search for only "chiropractor" However, search volume for "name-of-town chiropractor" is significantly high! I'd really appreciate some input on this. Thanks so much in advance, Jarod
Local SEO | | marshalllj0 -
Duplicate content across a number of websites.
We have a client who has approximately 25 retail sites (mini department stores) selling in general the same merchandise ranges - some stores carry all the ranges (brands) while others have fewer due to space restrictions. Each destination is different has its own branding and unique selling point which needs to be reflected. The client wants us to build individual websites for each location as they want to promote each location individually. I know that the search engines don't penalise duplicate content, but the core of each website is going to be essentially the same. My concern is there is no way you could write 25 different pages about the same Colony Candle range! Any ideas suggestions would be much appreciated - a one site option would not work as the client wants individual website and due to the different branding, USP and the fact they want to market them individually I would agree with them. Thanks Fraser
Local SEO | | fraserhannah0 -
Meaningful analytic benchmarks and insights for 100+ websites?
Hey all! I work for an association that has over 100+ member businesses. These businesses are dispersed through out North America and each have their own website, totally independent of each other in look, feel, functionality, etc.. While most of these businesses offer the same core businesses such as a gym, summer camp and preschool, none of the website structures, calls to actions, etc. are the same. I have a feeling that there could be some interesting and meaningful analytics that I could pull together if I had access to all their Google Analytics accounts, but I'm not quite sure what they would be. Some ideas I have - 1 - Percentage of traffic from social media - will give insight as to which businesses in the association are using social successfully. 2 - New vs. Returning traffic - a high percentage of returning traffic might be indicative of more useful websites. 3 - Mobile usage - How mobile savvy are the customers of different businesses in the association. Any other analytics (and quite frankly, more meaningful/impactful than the ones I posted above) that you guys can think of? Thanks for your help! Chris
Local SEO | | JCCA1 -
How to remove countries viewing my website
Hi All, I operate from the UK only. How can I exclude select countries from viewing both my organic website and Google Adwords listing. Organic Website
Local SEO | | Mark_Ch
Are the any free online services that give you a simple click + download/view script to cut & paste into a .htaccess file. Google Adwords
Ditto as above with the exception to paste the IP list into Campaign | Setting Tab | Advanced settings - IP exclusions Thanks Mark0