What causes Crawl Diagnostics Processing Errors in seomoz campaign?
-
I'm getting the following error when seomoz tries to spider my site:
First Crawl in Progress! Processing Issues for 671 pages Started: Apr. 23rd, 2011
Here is the robots.txt data from the site:
Disallow ALL BOTS for image directories and JPEG files.
User-agent: *
Disallow: /stats/ Disallow: /images/
Disallow: /newspictures/
Disallow: /pdfs/
Disallow: /propbig/
Disallow: /propsmall/
Disallow: /*.jpg$
Any ideas on how to get around this would be appreciated
-
Open a ticket.
http://seomoz.zendesk.com/home
They are pretty good and should get back to you in a day or 2.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Rankings confusion in pro campaign
Hello Moz-world! I recently set up a new campaign, and the crawl is still in the process of wrapping up (been 4 days). When I look at my rankings it tells me "not in the top 50" then when I scroll over, it shows me that my client is ranking in position 3, in the instance of one keyword. Anyone know why there is a discrepancy between what the report shows, and what it shows when you mouse over the rankings? Thanks! Tyler
Moz Pro | | kbaltzell0 -
Seomoz crawler problems
I have had Seomoz for about a month. It has crawled about 1000 pages. I have about 10,000 pages total for the site. Why are these others being a problem? I have contacted help but the guy isn't any help, we have just been going back and forth for the last two weeks. Any suggestions?
Moz Pro | | EcommerceSite0 -
How reliable is SEOMOZ data?
I have been using the Mozbar data to locate Auth websites, basically the higher the DA/PA the better it is. If I then check the site out and they have good load times, lots of social sharing etc this makes it extra special and now a good site to try and get a link on. I found 3 blogs to guest post on which all have DA/PA 80+ some of the blogs have a PR7. Now this is great but what scares me is have I just wasted 3 guest posts because the data is incorrect. These blogs are run by 1 person and the kind of work involved to achieve those stats would be very heavy. Maybe this blogger has just hit the nail on the head with SEO and link building. Input anyone?
Moz Pro | | activitysuper0 -
How to remove URLS from from crawl diagnostics blocked by robots.txt
I suddenly have a huge jump in the number of errors in crawl diagnostics and it all seems to be down to a load of URLs that should be blocked by robots.txt. These have never appeared before, how do I remove them or stop them appearing again?
Moz Pro | | SimonBond0 -
Is there a way in in the pro campaign to initiate an instant crawl?
I have a campaign that's on a very small website at this point. It's only 9 pages, so a crawl would only take a few minutes. Is there a way to start a quick crawl at my request instead of having to wait a week to see if I fixed the issues it found during the last crawl? I've been hunting around, but I don't see a way.
Moz Pro | | mytouchoftech0 -
Can I do a campaign for just a page?
We've been doing a lot of building and work on just one category page, but when i try to put it in the campaign it won't let me do any url that has a sub folder like www.mainsite.com/keyword-page. I can only do www.mainsite.com, and when i select the other campaign options like root domain or sub folder, roger pops up with an error. Is anyone else having this problem?
Moz Pro | | anchorwave0 -
SEOmoz LDA tool experience?
http://www.seomoz.org/labs/lda Does anyone presently use this tool as a regular part of their SEO analysis? Does anyone have any updates regarding this tool? It is still in the lab despite no updates for over 6 months. Is it being retired? Or promoted to production? If you do use the tool, what % of relevance is your goal when optimizing pages?
Moz Pro | | RyanKent0 -
SEOmoz keyword rankings in campaign report
Hi. Does anybody know where the rankings summary has moved to in the campaign reports? I want to know how many keywords have moved up or down in the last week and can't find it anywhere!
Moz Pro | | neooptic1