Interesting. I look forward to hearing your results, as my robots.txt file is also set to:
Crawl-delay: 1.
Latest posts made by ryanjcormier
-
RE: What's the best way to eliminate "429 : Received HTTP status 429" errors?posted in Moz Pro
-
RE: What's the best way to eliminate "429 : Received HTTP status 429" errors?posted in Moz Pro
Chase,
They ran a bunch of internal diagnostic tools on my site, and were unable to replicate the 429 errors. They ended up telling me exactly what they told you. I haven't noticed any issues with my site's rankings, or any flags in Webmaster Tools, so it looks like they are right so far. I just hate logging into Moz and seeing all those crawl errors!
-
RE: What's the best way to eliminate "429 : Received HTTP status 429" errors?posted in Moz Pro
Many thanks - I will contact them now!
-
What's the best way to eliminate "429 : Received HTTP status 429" errors?posted in Moz Pro
My company website is built on WordPress. It receives very few crawl errors, but it do regularly receive a few (typically 1-2 per crawl) "429 : Received HTTP status 429" errors through Moz.
Based on my research, my understand is that my server is essentially telling Moz to cool it with the requests. That means it could be doing the same for search engines' bots and even visitors, right? This creates two questions for me, which I would greatly appreciate your help with:
-
Are "429 : Received HTTP status 429" errors harmful for my SEO? I imagine the answer is "yes" because Moz flags them as high priority issues in my crawl report.
-
What can I do to eliminate "429 : Received HTTP status 429" errors?
Any insight you can offer is greatly appreciated!
Thanks,
Ryan
-