Welcome to the Q&A Forum

Browse the forum for helpful insights and fresh discussions about all things SEO.

Your browser does not seem to support JavaScript. As a result, your viewing experience will be diminished, and you have been placed in read-only mode.

Please download a browser that supports JavaScript, or enable it if it's disabled (i.e. NoScript).

What causes Crawl Diagnostics Processing Errors in seomoz campaign?

Moz Pro

1742

cmaddison last edited by

I'm getting the following error when seomoz tries to spider my site:

First Crawl in Progress! Processing Issues for 671 pages Started: Apr. 23rd, 2011

Here is the robots.txt data from the site:

Disallow ALL BOTS for image directories and JPEG files.

User-agent: *

Disallow: /stats/ Disallow: /images/

Disallow: /newspictures/

Disallow: /pdfs/

Disallow: /propbig/

Disallow: /propsmall/

Disallow: /*.jpg$

Any ideas on how to get around this would be appreciated
1 Reply Last reply
Reply Quote 0
BlinkWeb last edited by

Open a ticket.

http://seomoz.zendesk.com/home

They are pretty good and should get back to you in a day or 2.
1 Reply Last reply
Reply Quote 0

Got a burning SEO question?

Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.

Start my free trial

Browse Questions

View

From

Sorted by

With category

Explore more categories

Related Questions

Duplicate title on Crawl

Ok, this should hopefully be a simple one. Not sure if this is a Moz crawl issue of redirect issue. Moz is reporting duplicate title for www.site.co.uk , site.co.uk and www.site.co.uk/home.aspx is this a canonical change or a moz setting I need to get this number lower.
Moz Pro | | smartcow

0
Why cant I open my Campaigns

When i go to the Campaigns URL , Its not allowing me to open in order to view my ranking. Why?
Moz Pro | | CBC1

0
Crawl Diagnostics

My site was crawled last night and found 10,000 errors due to a Robot.txt change implemented last week in between Moz crawls. This is obviously very bad so we have corrected it this morning. We do not want to wait until next Monday (6 days) to see if the fix has worked. How do we force a Moz crawl now? Thanks
Moz Pro | | Studio33

0
Wordpress.com does no allow google analytics will that effect my seo campaign started with seomoz?

Hello All, Since I have my domain mapped to wordpress.com site which does not allow google analytics ... I am worried if it would effect my seo campaign out here . While i see on the seomoz platform, i am being prompted for analytics I wish to know if its ok running seo campaign without analytics ? If not , what should i do to avail analytics ??
Moz Pro | | mysayindia

0
Can I exclude a sub-domain from SEOMoz campaigns?

We have recently implemented a white label site that is on a sub-domain. The site employs noindex on most of the pages I imagine due to duplicate content concerns on other white label versions of the site. It has led to a spike of over 14 thousand notices on our report. Is there a way to exclude a sub-domain from the SEOMoz scans and reports?
Moz Pro | | TSDigital

0
Can I combine SEOmoz Campaigns.

Basically I am in internal SEO. We subscribe to SEOmoz and we have 5 campaign spots. each with their own allocation of keywords. Ideally I only want to track our site and not 4 other's. I've currently setup the campaign a couple of times with different keywords, but it would be much better if I could choose what allocates to what. I.e. 2 campaign tokens to one site and 3 to another or just 5 to one site. Is this possible, and if not why not?
Moz Pro | | DaveDawson

0
SEOmoz indicating duplicate page content on one of my campaigns

Hello All, Alright, according to SEOmoz's PRO campaign manager, one of my websites is returning about 2,700 pages that supposedly have duplicate content. I checked a few of them manually and am not seeing where the issue lies. Is anyone else experiencing something similar to this and do you know if it is just a glitch with the crawl? Here are 2 of the pages it is indicating have dup page content: http://www.dieselpowerproducts.com/c-3120-1994-98-59l-12v-dodge-cummins-carbon-fiber-hoods.aspx http://www.dieselpowerproducts.com/c-90-dodge-cummins-94-02-59l-12v24v.aspx Any insight would be greatly appreciated! -Craig
Moz Pro | | ckilgore

0
Crawl Diagnostics Report Lacks Information

When I look at the crawl diagnostics, SEOMoz tells me there are 404 errors. This is understandable, because some pages were removed. What this report doesn't tell me is how those pages were discovered. This is a very important piece of information, because it would tell me there are links pointing to those pages, either internal or external. I believe the internal links have been removed. If the report told me how if found the link, I would be able to take immediate action. Without that information, I have to go so a lot of investigation. And when you have a million pages, that isn't easy. Some possibilities: The crawler remembered the page from the previous crawl. There was a link from an index page - i.e. it is in the database still There was an individual link from another story - so now there are broken links Ditto, but it in on a static index page The link was from an external source - I need to make a redirect Am I missing something, or is this a feature the SEO Moz crawler doesn't have yet? What can I do (other than check all my pages) to discover this?
Moz Pro | | loopyal

0