408 errors in crawl diagnostics
-
Best community,
The Crawl Diagnostics Report of Moz gave our website a lot of 408 errors like below:
<dl>
<dt>Title</dt>
<dd>408 : Error</dd>
<dt>Meta Description</dt>
<dd>408 Request Time-out</dd>
<dt>Meta Robots</dt>
<dd>Not present/empty</dd>
<dt>Meta Refresh</dt>
<dd>Not present/empty</dd>
<dd>-----------------------------------------------------------------------</dd>
<dd>The report has diagnosed a lot of these (around 320), even though we cannot reproduce the error (we cannot seem to find it ourself). </dd>
<dd>2 questions relating to this: </dd>
<dd>* Can you (the people of Moz) reproduce the errors manually? </dd>
<dd>* Is it possible that it is a bug in the spider of Moz itself (too many spiders crawling at the same time)?</dd>
</dl>
-
Hi Arjen,
408 errors are timeout type errors so the first thing that comes to mind is what kind of web server you are on. If it is shared then there might have been a surge in traffic to your site or another site on the same host and this slowed down requests enough that the moz crawler got these results returned. You could try running a scan with screaming frog which will scan the site in a similar way to the moz crawler (ie multiple requests at the same time) and if you see the errors there also then this can confirm that the issue is likely with your server setup and not a moz bug.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Crawler triggering Spam Throttle and creating 4xx errors
Hey Folks, We have a client with an experience I want to ask about. The Moz crawler is showing 4xx errors. These are happening because the crawler is triggering my client's spam throttling. They could increase from 240 to 480 page loads per minute but this could open the door for spam as well. Any thoughts on how to proceed? Thanks! Kirk
Moz Bar | | kbates1 -
Error Code 803: Incomplete HTTP Response Received
On 5 pages on our site we've got an Error Code 803: Incomplete HTTP Response Received. We checked the network interface within the browser inspector, which did not return any errors, this would mean than there were no issues with retrieving resources from the server. In the console log there are no errors also. We also inspected the URL bar settings and can see each page is loaded under a secure connection with no errors. When using http://www.webconfs.com/http-header-check.php there was a "HTTP/1.1 301 Moved Permanently" issue. A little in the dark on what to do next. Any help would be amazing!
Moz Bar | | EdLongley0 -
Rogerbot will not crawl my site! Site URL is https but keep getting and error that homepage (http) can not be accessed. I set up a second campaign to alter the target url to the newer https version but still getting the same error! What can I do?
Site URL is https but keep getting and error that homepage (http://www.flogas.co.uk/) can not be accessed. I set up a second campaign to alter the target url to the newer https://www.flogas.co.uk/ version but still getting the same error! What can I do? I want to use Moz for everything rather than continuing to use a separate auditing tool!
Moz Bar | | digitalascend0 -
Crawl Test Takes Long Time
Hi Moz, I have submitted our website for a crawl test. Usually it would only take a few hours to do the crawl. However this time, it takes quite long time and the result still shows in progress 😞 This is a small website which only contains less than 10 pages. Just wondering if this is our website setting issue or it is a technical issue at your end? Many thanks in advance. sFjAERG.png
Moz Bar | | russellbrown0 -
Crawl Test cannot be seen on my PC. Using Windows 8.
I received and downloaded my Crawl Test. When I try to open it, my pc says "This app can't run on your PC. To find a version for your PC, check with the software publisher". I'm running Windows 8. Can I view my Crawl Test with my PC? Is there a work-around for this issue? Update I can apparently open my Crawl Test and view it as an Excel Spreadsheet. But when I download it and choose Save As, it saves it as a MS-DOS Application. This is my very first Crawl Test and I am not sure if I am doing everything right.
Moz Bar | | jameskoby010 -
Did the Crawl Test tool go away or was it replaced
I loved that tool as it provided me with all of my URLs and it was easy to catch all errors at once. I had it booked marked but now I am just going to the regular tools page.
Moz Bar | | KJ-Rodgers0 -
Moz Crawl Test: Referrer is sitemap.gz?
Hi,
Moz Bar | | Titan552
I'm looking at a crawl test report, and I'm seeing that most of the pages have the sitemamp.gz file listed as the referrer. As I recall in my other reports the referrer is usually the root domain - unless of course there's a redirect. Does having sitemap.gz as the referrer indicate a problem? If so, what problem does it indicate? Thanks!0 -
Is there a problem with New Campaign crawls being slow?
Hi I've created 3 new campaigns but results not showing as usual. I know the full results take up to 7 days but I usually see some basic info in a few minutes of creating the campaign. This problem happened a while ago and the campaign was never quite right in SEOMoz. Thanks for your help Steve
Moz Bar | | stevecounsell0