I want to check which pages have been crawled
-
I would like to find out which pages have been crawled by seomoz on my site
-
From the page with Crawl Diagnostics on your Campaign you can export all the data to CSV. This will provide you with an overview of all urls SEOMoz crawled during it's last crawl.
-
You can use this to get a crawl report including a list of all pages crawled.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Product Page Links
I have a product category page at https://www.hurtlegear.com.au/s1000rr/ which currently has 38 products on it. Problem is, all the product titles start with the name of the text: "bmw s1000rr" (because that's what they are) - so that means there are 38 anchored internal links on that page, all starting with the same keyword. You can see how that might look to the Google crawler. Recently that page dropped from around 15 to outside the top 100, and Moz tells me that the page is keyword stuffed with "bmw s1000rr" (no suprise) so I'm guessing that may be the reason the page has disappeared out of the SERPs. I don't really want to change all the product titles (then they wouldn't make sense) so I'm just wondering if there is any way around this? Is there some way of telling Google that this is a product category page and therefore to ignore the anchor text in all of those product links? Can/should the links have some kind of markup on them? Or is the page beyond help? Basically I'm looking at a way of keeping the product titles as they are, but avoiding a page penalty from Google somehow. I'm a bit of a newbie, any suggestions would be most appreciated. Cheers, Graeme
On-Page Optimization | | graeme720 -
Pages for similar keywords?
I have a site that wants to target the keywords listed below. They are a small company with just a few ski chalets in Val d'Isere, a ski resort in France. They don't have ski chalets in any other ski resort. Val d'Isere chalets
On-Page Optimization | | Marketing_Today
luxury ski chalets
luxury ski chalets Val d'Isere
catered chalet Val d'Isere
catered chalet val d isere
catered ski chalet val d'isere
catered ski chalets
chalets in Val d'isere
chalets in val d isere
luxury catered ski chalets
luxury ski chalets Their domain name includes "valdisere" but I can't get this site onto Page 1, it keeps lingering on Page 2 and 3. I wondered how you would approach this site with pages? Would you reply on the homepage to rank for all these terms or create seperate pages for the terms, and if so how would you group the terms per page?0 -
Crawl Diagnostics Updates
I have several page types on my sites that I have blocked using the robots.txt file (ex: emailafriend.asp, shoppingcart.asp, login.asp), but they are still showing up in crawl diagnostics as issues (ex: duplicate page content, duplicate title tag, etc). Is there a way to filter these issues or perhaps there is something I'm doing wrong resulting in the issues that are showing up? Ryan
On-Page Optimization | | ryanforrest0 -
How should i optimize this page
Hi, i am having major problems in optimizing this page as it is a magazine site. On normal sites i have no problem in optimizing the page to get the correct keywords to come up in the search engines but since the upgrade and also because it is a magazine site, i am having problems on how i should do this. my site is www.in2town.co.uk and i am trying to optimize the page for the following keywords lifestyle magazine online magazine lifestyle news Life and Style articles healthy lifestyle i am trying to make sure that google knows what the magazine is about, as i know have dropped down the rankings since the upgrade and for lifestyle magazine we were number one in google for such a long time but now we are on page 9 and this is our home page. we are seeing sites that have hardly any content ranking above us for this keyword i have a small intro which i have just put in the past few days at the top and we have a welcome in the middle which is here. Welcome to In2town Lifestyle Magazine Our Lifestyle Magazine is a fresh, innovative and vibrant online magazine offering you the best in health,fitness and life & style features, as well as modern lifestyle, beauty, fashion, personal finance and entertainment. Over the years In2town Lifestyle Magazine has established a reputation for quality articles and informed lifestyle and health features thanks to our experienced team of editorial professionals. By reading our online Lifestyle Magazine, you will be able to enjoy the interesting mix of entertainment features, health and lifestyle news as well as finding out what is happening in the celebrity world. We are always happy to hear from our readers, if you have lifestyle news or a story that you feel our readers would be interested in then please do contact us. xxxxxxxx but i would like to get rid of that section as i am going to put the latest articles there. any advice on how to sort this mess out would be great
On-Page Optimization | | ClaireH-1848860 -
Wrong Page is Ranking
My client is an Ecommerce reseller of a few major scooter brands. We currently rank fifth for a particular brand name but our main brand page isn't the one that ranks. Instead, it's a product page. The main brand page has an A rating from Moz for the desired keyword phrases. Neither page has any backlinks. Any ideas on why our main brand page would be outranked by a product page? What could we do to change this?
On-Page Optimization | | TrinShin0 -
How do I get rid of crawl errors?
I recently revamped all my category pages to make them Google friendly. I did a lot of keyword research and ended up deleting categories and renaming categories. Now Google Webmasters is showing a ton of 404 errors. How can I get rid of them? Do I have to remove the URL one by one with Google Webmasters? Is it something that won't hurt my rankings and will go away in time?
On-Page Optimization | | dealblogger0 -
Pages crawled dropped like a stone
set up a new campaign seomoz crawled the site and did about 1500 pages the last crawl it now only lists 1 page I can see anyway to see why, the site has not changed so why has the number of pages dropped?
On-Page Optimization | | spiralsites0 -
Homepage ranking before optimized page
We finally managed to obtain a spot in the first 10 positions of the serps for our main keyword. Since a week, our homepage started ranking in the top 15 as well, so we we're pretty excited about that. On our way to dominate the top 10! Since 2 days we started to rank with our homepage before our optimized page, which sucks because the metadescription (made up by Google) isn't helping our CTR. Is there a way that we can show Google that the other page is more relevant than the homepage? Or do we have to wait until we have build up enough PA to switch places with the homepage (seems unlikely to me).
On-Page Optimization | | duoweb0