SEOmoz crawler not crawling my site
-
We set up a new campaign in SEOmoz on Friday. It is my understanding that the preliminary crawl can cover up to 250 and this has been our experience in the past. However, the preliminary crawl only went through 2 pages. This is a larger eCommerce site with many pages. Any ideas why more pages weren't crawled?
We set up the campaign to track at the root domain level.
-
Thanks, Ruth. I see what you're saying about the crawl now. I'll go ahead and reach out the help team. Hopefully we can figure it out!
-
So that's really what I meant was "as long as you're seeing the full crawl," was that if your next crawl found the whole site it would probably be fine. It sounds like that's not the case, so I think the Help Team is your best bet - they're far more able to diagnose campaign-specific issues than I am
-
Thanks for the reply Ruth!
I was a little unclear as to part of your response. What were you referring to when you said "as long as you continue seeing the full crawl, you should be good to go"?
Where should I be seeing the full crawl? When I look at the Crawl Diagnostic Summary, it notes that the last crawl was on May 10, 2013 (the day we set up the campaign) and the next crawl is to start May 18, 2013. I received email notification that SEOmoz was successfully recrawled it May 11, 2013. Similar to the May 10 crawl, the May 11 crawl only went through 2 pages.
I also checked up on our robots.txt and tags. There isn't blocking anything the crawler on that front.
-
Hmm! Well, it could be a couple of things.
If your full crawl ends up crawling the whole site, it's possible that the preliminary crawl timed out on a request to your site. As long as you continue seeing the full crawl, you should be good to go.
If your next crawl continues showing just a few pages, I would check to make sure you're not blocking robots with either the meta robots tag, a robots.txt file, or nofollowed links. If you don't uncover anything out of the ordinary there, it could be an account- or campaign-specific error on our end; please email help@seomoz.org and our super-awesome Help Team can help get that fixed.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
One of my sites fell off the earth
I manage a handful of sites and have ranked top 5 for a handful of keywords for a long time. I recently checked one of my clients websites and other tier 2 pages will come up but the home page is now not showing up for any listings on Google. Was there a recent update was I put in the mysterious sandbox? I have not modify anything or using any black hat seo tricks. Only thing that was done is the client installed demand force onto their website. Any feedback about an update or about demand force or issue would be helpful. The site is https://www.nwichiropractic.com/
Moz Pro | | Tylerr19850 -
SEOMOZ Support: Domain Name Change in SEOMOZ
My client is changing their domain name. They are redirecting (301) all of their URLs to the new domain. Do I need to do anything in SEOMOZ to preserve the campaign?
Moz Pro | | DynoSaur0 -
SEOMoz Langage ?
Hello, Is there any way to change the lagage of the interface ? Especially for reporting tool ? Thanks in advance for your answer, Alex
Moz Pro | | ACORED0 -
What do I do about accessing open site explorer?
I am stuck in the redirect loop which seems to have become commonplace when seeking to access open link explorer... I have cleared my cache. I have reset and restarted my browser. And I think I have done what I need to do with cookies. Someone please help me - I am using 10.6.8 OSX - Safari - but have also tried chrome thanks in advance be blessed bd
Moz Pro | | creativeguy0 -
Question about how to do keyword research on SEOMoz
Is there a way I can check what are the Keywords that drive traffic to a specific website using SEOMoz?
Moz Pro | | theLotter0 -
How do I collect all links through the SEOMoz API?
How do I collect all links through the SEOMoz API? Yes, I know how to pull url metrics info but want to pull the inbound links only via php script w/out having to go to the OSE page to pull. any suggestions would be great!
Moz Pro | | destdigi0 -
Drop in Number of Crawled pages by SEOMOZ?
I noticed that the number of Crawled Pages on my website has been 2 pages only over past week. Before that the number of crawled pages was over 1000. My site has numerous pages as it is a Travel website that pulls search results for Flights, Cars, Hotels, Cruises and Vacation packages so there is a huge Database there. Can someone help? Thanks !
Moz Pro | | sherohass0 -
SEOmoz crawl diagnostics report - what are the duplicate pages urls?
I just see the number of duplicates but not what the urls of the duplicates are? I don't see it in the export either, but maybe I'm missing it Cheers S
Moz Pro | | firstconversion0