False 5xx Errors for ColdFusion website
-
For several years month after month MOZ crawl reports 5xx errors on many pages. Almost every time all the pages work fine as fa as i could see. Google webmaster tools does not notice any errors.
Could anyone explain how to fix this situation?
Should i get a refund from MOZ?
-
Unlike 3XX (301, 302 etc) or 4XX (404 etc) errors, 5XX errors are actually highly variable and relate to server errors. A page can give a 5XX error one second and then in a few seconds, return a full page instead. If you encounter high volumes of 'false-positive' 5XX or 0 (time out) errors, it's usually a sign that at a certain time your server is under strain and Moz is crawling it a bit too quickly (thus resulting in false positive 5XX errors)
This could be if Moz decides to crawl your sit too quickly at peak operating time, or if Moz crawls your site when it's running something like a cron job (assuming that the job is handled by the same server which is handling your web requests). There can be many other reasons for 5XX false positives, but this is the most common
You can delay Moz's crawl bot (rogerbot) from crawling your site too frequently:
See if that helps. Keep in mind the change won't be instant, it may take a few weeks for it to be processed effectively. We had to do this recently for a client's site which was bound to a ridiculously weak hosting environ
Hope that helps!
-
Hey, thanks for reaching out!
So it's entirely possible for our user-agent to get a response that doesn't reflect the same when you view it in a browser. Have you checked your server logs for these 5xx errors responding to our user agent "rogerbot" to check if you see it on your end? If you want to send us an email to help@moz.com, we can take a look into your specific example here, so we can make sure we have access to report on your site properly.
thanks!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved Performance Metrics crawl error
I am getting an error:
Product Support | | bhsiao 0
Crawl Error for mobile & desktop page crawl - The page returned a 4xx; Lighthouse could not analyze this page.
I have Lighthouse whitelisted, is there any other site I need to whitelist? Anything else I need to do in Cloudflare or Datadome to allow this tool to work?1 -
Solved Mozbar Chrome Extension 404 Error
Hello, I am trying to check my website https://whatnumberisiv.com Domain Authority but my Mozbar is not working, When I try to install Mozbar Chrome Extension; it is showing 404 Error. What is the solution of this error? whatnumberisiv.com
Product Support | | Sohail03730 -
Crawl error robots.txt
Hello, when trying to access the site crawl to be able to analyze our page, the following error appears: **Moz was unable to crawl your site on Nov 15, 2017. **Our crawler was banned by a page on your site, either through your robots.txt, the X-Robots-Tag HTTP header, or the meta robots tag. Update these tags to allow your page and the rest of your site to be crawled. If this error is found on any page on your site, it prevents our crawler (and some search engines) from crawling the rest of your site. Typically errors like this should be investigated and fixed by the site webmaster. Can help us? Thanks!
Product Support | | Mandiram0 -
HTTPS (SSL) Error Encountered.
Hi guys, We received the following error from our Moz report, our hosting companies says it's isn't an issue but I wanted to get your feedback as it seems a bit odd. We recently moved eventfull.co.nz to a VPS and setup an EV SSL. We moved another site to the same VPS and added EV SSL and it isn't reporting any issue. Hosting companies feedback below error message | Crawl Error Error Code 804: HTTPS (SSL) Error Encountered Your page requires an SSL security certificate to load (using HTTPS), but the Moz Crawler encountered an error when trying to load the certificate. Our crawler is pretty standard, so it's likely that other browsers and crawlers may also encounter this error. If you have this error on your homepage, it prevents the Moz crawler (and some search engines) from crawling the rest of your site. | | I am just running some tests on the SSL cert installation now, but so far all appears to be fine. I've checked your .htaccess file and there is nothing that should be blocking them, and the logs show nothing unexpected or any SSL failures. SSL Labs test returns an A rating with no errors. One possibility (though, it's a long shot) is that we never increased the HSTS time beyond 3600, so it's possible that the crawler is failing because of this perceived insecurity. However, if there is some other issue going on, increasing the HSTS time would be a bad idea, so I suggest some further monitoring and testing. You may need to contact Moz about the issue and see if they can help. Is there any other evidence of SSL failing to load? Have you experienced any other issues, or is it only the Moz report that is indicating any problem? |
Product Support | | ModowestNZ0 -
Are these MA dashboard issues errors or ccorrect ?
Hi As you know i had spotted some bugs with the new MA dash and now on a more recent report update for a project see the below messages so pls confirm if they are bugs or genuine so i know to inform clients dev to attend to or not ? (PM me for the client/project name if you need it): Crawl Error Moz was unable to crawl your site during the last campaign update!We encountered the following issue:904 Response from Server Timed out Without Completing Page Request Crawl Issue Found: 500 Errors More than 5% of site pages served 500 errors during the last crawl
Product Support | | Dan-Lawrence0 -
Analytics Linking Error
Our team keeps getting this Analytics error, "It appears there's a problem with our connection to your Google Analytics account. Please go to your Settings page to update your connection," The issue is that we have linked appropriately several times now. Anyone else having this issue? Glitch?
Product Support | | jgrammer0 -
Showing 302 redirection error instead of 404
Moz is showing 302 error instead of 404 in the Crawl Diagnostics Summary report. But there is no such page uploaded ever to the site. Please let me know why this is happening. eg: http://www.zco.com/images/2d-game-development.aspx
Product Support | | zco_seo0 -
Traffic Data Report Error: Anyone else?
I included a screenshot of the report. I had a 111 organic visits for last Mondays past week report, this Monday it is telling me I had 0. It's also telling me I have -10 non-branded keywords. I know the organic search visits isn't 0. Also, (this part I'm not sure about) but I don't see how I could have a negative amount of non-branded keywords. I would think it would just stop at 0. Has anyone had something like this happen? Or am I just missing something? Thanks for any help or comments. zK3FbG4.png
Product Support | | KempRugeLawGroup0