0 status codes

[eLab_London]

Hi,

I am hoping someone could help explain - I have a screaming frog account and ran a crawl using it, it returned a lot of 0 status codes 'connection timeout', 'DNS lookup failed' and 'Connection Refused'. However, the SEO MOZ Crawl doesn't detect any of this.

I am fairly new to these tools, do you know why this is?

Thanks a lot!

[Bob_van_Biezen]

Hi Kayleigh,

Like Patrick said, just try to recrawl these pages. I assume that will fix the problem.

If that still gives the errors I would make sure to try it again with adjusted speed. Some servers automatically block crawlers (IP’s) that give a spike in there server requests. Screaming Frog can easily trigger this (happened to me aswell). You can set the speed under configuration.

If you give this a try I would go with one thread at a time and 0,5 URL’s a second. That worked for me. When it was a block it could be needed to get your IP address unblocked before you try it again. Good luck!

[PatrickDelehanty]

Hi Kayleigh

This happens from time to time. Sometimes I will pull the URLs I get those 0 status errors for and recrawl them. It's no big deal, sometimes you just have to mess with the configuration of your crawls.

ScreamingFrog offers some tips in their FAQ section, you can read those here.

Hope this helps! Let me know if you have any more questions or comments.