Welcome to the Q&A Forum

Browse the forum for helpful insights and fresh discussions about all things SEO.

Your browser does not seem to support JavaScript. As a result, your viewing experience will be diminished, and you have been placed in read-only mode.

Please download a browser that supports JavaScript, or enable it if it's disabled (i.e. NoScript).

What causes Crawl Diagnostics Processing Errors in seomoz campaign?

Moz Pro

2

2

1742

Log in to reply

cmaddison last edited by

I'm getting the following error when seomoz tries to spider my site:

First Crawl in Progress! Processing Issues for 671 pages Started: Apr. 23rd, 2011

Here is the robots.txt data from the site:

Disallow ALL BOTS for image directories and JPEG files.

User-agent: *

Disallow: /stats/ Disallow: /images/

Disallow: /newspictures/

Disallow: /pdfs/

Disallow: /propbig/

Disallow: /propsmall/

Disallow: /*.jpg$

Any ideas on how to get around this would be appreciated
1 Reply Last reply
Reply Quote 0
BlinkWeb last edited by

Open a ticket.

http://seomoz.zendesk.com/home

They are pretty good and should get back to you in a day or 2.
1 Reply Last reply
Reply Quote 0

Got a burning SEO question?

Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.

Start my free trial

Browse Questions

View

From

Sorted by

With category

Explore more categories

Related Questions

My Campaign only crawled 3 pages on my site

On my first crawl of a new campaign, the software only crawled 3 pages. XXXaceXXXscholarships.org any ideas?
Moz Pro | | Santaur

0
Is there a way to get SEOMOZ to not throw an error if i'm using the rel=canonical tag?

There are so many errors (~1500) that I can't find the pages with duplicate content among the ones that are correctly tagged
Moz Pro | | seospeedwagon

0
Is there a way you can determine the time SEOMoz crawls your website

I'm a new user to SEOMoz Pro, and having created a number of campaigns I wanted to know if you can set / schedule when SEOMoz crawls your website? Ideally I want to prevent SEOMoz from crawling my site at certain times, but I can't seem to find a way of doing this. Thanks in advance.
Moz Pro | | Simon_Glanville

0
Why is my crawl STILL in progress?

I'm a bit new here, but we've had a few crawls done already. They are always finished by Wednesday night. Our website is not large (by any means), but the crawl still says it's in progress now 3 days later. What's the deal here?!?
Moz Pro | | Kibin

0
Slowing down SEOmoz Crawl Rate

Is there a way to slow down SEOmoz crawl rate? My site is pretty huge and I'm getting 10k pages crawled every week, which is great. However I sometimes get multiple page requests in one second which slows down my site a bit. If this feature exists I couldn't find it, if it doesn't, it's a great idea to have, in a similar way to how Googlebot do it. Thanks.
Moz Pro | | corwin

0
20000 site errors and 10000 pages crawled.

I have recently built an e-commerce website for the company I work at. Its built on opencart. Say for example we have a chair for sale. The url will be: www.domain.com/best-offers/cool-chair Thats fine, seomoz is crawling them all fine and reporting any errors under them url great. On each product listing we have several options and zoom options (allows the user to zoom in to the image to get a more detailed look). When a different zoom type is selected it adds on to the url, so for example: www.domain.com/best-offers/cool-chair?zoom=1 and there are 3 different zoom types. So effectively its taking for urls as different when in fact they are all one url. and Seomoz has interpreted it this way, and crawled 10000 pages(it thinks exist because of this) and thrown up 20000 errors. Does anyone have any idea how to solve this?
Moz Pro | | CompleteOffice

0
Is there any way to manually initiate a crawl through SEOMoz?

... or do you actually have to wait a week for the next scheduled crawl date on a particular campaign? We've just made a ton of changes to our site, and it would be helpful to know if they will generate any warnings or errors sooner rather than later. Thanks!
Moz Pro | | jadeinteractive

1
Deleted campaign?

I set up my campaign a few days ago and have just signed in to see if my site has bee fully crawled... and the campaign has been deleted. What could have gone wrong?
Moz Pro | | borderbound

0