What's the best way to eliminate "429 : Received HTTP status 429" errors?
-
My company website is built on WordPress. It receives very few crawl errors, but it do regularly receive a few (typically 1-2 per crawl) "429 : Received HTTP status 429" errors through Moz.
Based on my research, my understand is that my server is essentially telling Moz to cool it with the requests. That means it could be doing the same for search engines' bots and even visitors, right? This creates two questions for me, which I would greatly appreciate your help with:
-
Are "429 : Received HTTP status 429" errors harmful for my SEO? I imagine the answer is "yes" because Moz flags them as high priority issues in my crawl report.
-
What can I do to eliminate "429 : Received HTTP status 429" errors?
Any insight you can offer is greatly appreciated!
Thanks,
Ryan -
-
I have a customer that is using GoDaddy website hosting (at least according to BuiltWith) and I'm experiencing this same issue.
Any updates on this experiment from user rsigg? I'd love to know if I can remove this from my customer's robots file...
FWIW, Netrepid is a hosting provider for colocation, infrastructure and applications (website hosting being considered an application) and we would never force a crawl delay on a Wordpress install!
Not hating on the other hosting service providers... #justsayin
-
I am also on the same hosting and they have not been able to help with the 429. I have now started getting 429 errors when I attempt to login. Definitely something wrong with wp premium hosting.
-
Interesting. I look forward to hearing your results, as my robots.txt file is also set to:
Crawl-delay: 1.
-
We host on Media Temple's Premium WordPress hosting (which I do not recommend, but that's another post for another place), and the techs there told me that it could be an issue with the robots.txt file:
"The issue may be with the settings in the robots.txt file. It looks fine to me but the "Crawl-delay" line might be causing issues. I understand. For the most part, crawlers tend to use robots.txt to determine how to crawl your site, so you may want to see if Moz requires some special settings in there to work correctly."
Ours is set to:
Crawl-delay: 1
I haven't tried changing these values yet in our file, but may experiment with this very soon. If I get results, I'll post back here as well as start a new forum thread.
-
Chase,
They ran a bunch of internal diagnostic tools on my site, and were unable to replicate the 429 errors. They ended up telling me exactly what they told you. I haven't noticed any issues with my site's rankings, or any flags in Webmaster Tools, so it looks like they are right so far. I just hate logging into Moz and seeing all those crawl errors!
-
What'd they say Ryan? Having the same issue and just contacted Godaddy who told me that basically Moz's software is pinging my client's server too frequently so Godaddy is temporarily blocking their IP. They said it's not a concern though as they would never block Google from pinging/indexing the site.
-
Many thanks - I will contact them now!
-
Contact your host and ask let them know about the errors. More than likely they have mod_sec enabled to limit request rates. Ask them to up the limit that you are getting 429 errors from crawlers and you do not want them.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Pages with Duplicate Content Error
Hello, the result of renewed content appeared in the scan results in my Shopify Store. But these products are unique. Why am I getting this error? Can anyone please help to explain why? screenshot-analytics.moz.com-2021.10.28-19_53_09.png
Moz Pro | | gokimedia0 -
Viral Marketing SEO Question: If you build a truly great piece of content, what are the best ways to seed it?
There are a few techniques you can use to spread out and get your content out there.
Moz Pro | | shoobi
1. Email bloggers and tell them about your content
2. Share it on bookmarking sites (like Reddit)
3. Contact influential Twitter and Facebook profiles about it
4. Make it easy for visitors to share your infographic with an embed code at the bottom
5. Share it on infographic websites (like https://www.prizebondtime.com)
6. Share it with your email subscribers (if you have an email subscriber list)
7. Post it on your blog, Facebook page, Twitter, etc. Basically everywhere. The name of the game here is to get your content out in front of as many eyeballs you can as possible. Then after that, it's up to how good your content is to begin the viral loop.0 -
Is there a way to add captions to images in the YouMoz Editor?
As the title says, I'm working on a YouMoz post and want to add captions to some of my images. Is this not possible? Since some are justified strangely, I can't just do it with the p tags they offer... I tried dropping a div styled in there and it broke everything, unsurprisingly. Any suggestions? Thanks!
Moz Pro | | jesse-landry0 -
Results of keyword rankings way off??
I just did my first crawl, and a bunch of the keywords show my rank as being like 76 or 102 and I'm number 1 for the search when I search manually. **I of course have personal results turned off and I'm not logged into gmail when I search.
Moz Pro | | immortalgamer0 -
Moz's customer service. Is this normal?
A few days ago I noticed an issue with the on-page optimizer, when I couldn't find a solution, or even any mention of the problem in the forum I posted a ticket at the help desk.
Moz Pro | | Abidos
After ten hours I got a generic reply that didn't answer my ticket so I posted saying so.
After two days of not getting any reaction I looked through the forums again, this time searching for reactions about Moz's help desk. I found the post saying that sometimes the mail with a reply isn't received correctly so I went to the page of the ticket.
Here I saw that not only didn't I get an answer but my issue had been marked as solved, even though my last message clearly stated that it wasn't. This was three days ago. So my question is, is this how Moz usually treats it's clients? I'm new and my free trial is about to expire. At this point Moz should be impressing me with their great tools and services, convincing me it's worth my money. If I can barely get their attention now I don't expect it to change once I have payed them.0 -
Keyword research & how it's relevant to my site.
How do I know if I can compete on a particular keyword. Say the keyword analysis tool shows the keyword difficulty is 59%. How do I know what 59% means to my site, other than checking domain and page authority relative to my site (i.e. if sites in the top 10 are higher or lower authority than my site). Is there a way of showing what keyword difficulty percentage is a cut off point for my site? Thanks, Dan
Moz Pro | | dcostigan0 -
For the "On Page Report Card", Can I see a list of all of the recommendations?
On the "On Page Repord Card", in the "Page Analysis Detail" section, I can click "Read More" for each factor and see a "Recommendation" on how to fix the page to meet that factors criteria. Are these recommendations the same everytime or will they vary depending on the page itself? Can get a copy of each recommendation that would appear if none of the criteria were met? Thanks, Daniel.
Moz Pro | | iSenseWebSolutions1 -
What the . . ! Duplicate Pages and Titles WAY up?
My duplicate pages went up 50 plus in the past week, and my duplicate page titles went over more then 100. We recently redesigned the website, but it has been up for several weeks now. The only change I made specifically last week or late the week before was to get my 301 redirects done to get the www. version and the non www version pointing to the same place (as well as a couple other sites that point to it). I'm sure this is not enough info to figure out what went wrong . . . I'd love some help in figuring this out though.
Moz Pro | | damon12120