SEOmoz crawler not crawling my site
-
We set up a new campaign in SEOmoz on Friday. It is my understanding that the preliminary crawl can cover up to 250 and this has been our experience in the past. However, the preliminary crawl only went through 2 pages. This is a larger eCommerce site with many pages. Any ideas why more pages weren't crawled?
We set up the campaign to track at the root domain level.
-
Thanks, Ruth. I see what you're saying about the crawl now. I'll go ahead and reach out the help team. Hopefully we can figure it out!
-
So that's really what I meant was "as long as you're seeing the full crawl," was that if your next crawl found the whole site it would probably be fine. It sounds like that's not the case, so I think the Help Team is your best bet - they're far more able to diagnose campaign-specific issues than I am
-
Thanks for the reply Ruth!
I was a little unclear as to part of your response. What were you referring to when you said "as long as you continue seeing the full crawl, you should be good to go"?
Where should I be seeing the full crawl? When I look at the Crawl Diagnostic Summary, it notes that the last crawl was on May 10, 2013 (the day we set up the campaign) and the next crawl is to start May 18, 2013. I received email notification that SEOmoz was successfully recrawled it May 11, 2013. Similar to the May 10 crawl, the May 11 crawl only went through 2 pages.
I also checked up on our robots.txt and tags. There isn't blocking anything the crawler on that front.
-
Hmm! Well, it could be a couple of things.
If your full crawl ends up crawling the whole site, it's possible that the preliminary crawl timed out on a request to your site. As long as you continue seeing the full crawl, you should be good to go.
If your next crawl continues showing just a few pages, I would check to make sure you're not blocking robots with either the meta robots tag, a robots.txt file, or nofollowed links. If you don't uncover anything out of the ordinary there, it could be an account- or campaign-specific error on our end; please email help@seomoz.org and our super-awesome Help Team can help get that fixed.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Open Site Explorer detects links from a site that redirects to it? How is this possible?
I was checking external links to a site: scte-brasilien.de/ and was wondering why there are so many links pointing from another domain (reisen-nach-brasilien.com/) although it redirects to scte-brasilien.de/? So when checking the redirecting domain OSE knows its redirecting... The URL you've entered redirects to another URL. We're showing results for scte-brasilien.de/ since it is likely to have more accurate link metrics. See data forreisen-nach-brasilien.com/ instead? How is this possible? best regards
Moz Pro | | inlinear
Holger0 -
No Crawl data in dashboard
For the second straight week, I have had no crawl data in my dashboard. It seems like the crawler erased all my results in the pro dashboard. Is there a way to manually recrawl my site, since I will have to wait another week to see if it comes back to earth? Thanks
Moz Pro | | bedwards0 -
Crawl Diagnostics
Hello, I would appreciate your help on the following issue. During Crawl procedure of e-maximos.com (WP installation) I get a lot of errors of the below mentioned categories: Title Missing or Empty & Missing Meta Description Tag for the URLs: http://e-maximos.com/?like_it=xxxx (i.e. xxxx=1033) Any idea of the reason and possible solution. Thank you in advance George
Moz Pro | | gpapatheodorou0 -
Which of these is the best guest blogging site
Which of these is best: http://www.guestblogit.com/http://www.bloggerlinkup.com/ http://www.Myblogguest.comhttps://www.helpareporter.com/ I like the look of MyBlogguest.com so far. We are wanting to guest write articles to be published on quality sites in exchange for one or two links back (link building) Also, how do you choose what article topics to write. So far my strategy is to look at the industry's biggest sites and to use the "Top Pages" tab in OSE to look for hot topics. Thanks!
Moz Pro | | BobGW0 -
Why is the SEOmoz customer service on this site so awful?
Half the time the tools don't work and there isn't any accountability. Has anyone else had the same experience?
Moz Pro | | wpsoule1 -
SEOMOZ reports the statistics.
SEOMOZ reports the Statistics, but where do i manage & improve??? Simply Statistics is all about SEOMOZ??
Moz Pro | | webicers0 -
Is there any alternatives to Yahoo Site Explorer?
Hi, Is there any alternatives to Yahoo Site Explorer? I want to find backlinks of some unavailable pages and YSE was a great tool to deal with. But when I used tools like Open Site Explorer, ahrefs.com etc., I couldn't find one same like YSE. Because when I tried, it shows'No data available for this URL' where on YSE I found inbound links. What Alternatives Are There? thanks in advance!
Moz Pro | | VipinLouka780 -
Only Crawling 1 page?
Hi Guys, Any advice much appreciated on this! Recently set up a new campaign on my dashboard with just 5 keywords. The domain is brammer.co.uk and a quick Google site:brammer.co.uk shows a good amount of indexed pages. However - first seomoz tool crawl has only crawled 1 url!! "Last Crawl Completed: Apr. 12th, 2011 Next Crawl Starts: Apr. 17th, 2011" Any ideas what's stopping the tool crawl anymore of the site?? Cheers in advance.. J
Moz Pro | | lovealbatross0