Crawl Diagnostics Report 500 erorr

[Joseph-Green-SEO]

How can I know what is causing my website to have 500 errors and how I locate it and fix it?

[Cyrus-Shepard]

500 errors could be caused by a mulitude of reasons, and for the non-technical they can be very hard to track down and fix.

The first thing I would look at is if it's a repeating problem in Google Webmasters Tools, or a one-time issue. These errors will show up in GWT for a long time - but if it's not a repeating problem it probably is nothing you need to worry about.

Wait, I assumed you found the problems in GWT, when you may have possibly found them using the SEOmoz crawl report. Either way, you should probably log into  Google Webmaster Crawl Errors report and see if Google is experiencing the same problems.

Sometimes 500 errors are caused by over-aggressive robots and/or improperly configured servers that can't handle the load. In this case, a simple crawl delay directive in your robots.txt file may do the trick. It would look something like this:

User-agent: *
Crawl-delay: 5

This would request that robots wait at least 5 seconds between page requests. But note, this doesn't necessarly solve the problem of why your server was returning 500s in the first place.

You may need to consult your hosting provider for advice. For example, Bluehost has this excellent article on dealing with 500 errors from their servers: https://my.bluehost.com/cgi/help/594

Hope this helps! Best of luck with your SEO.

[Joseph-Green-SEO]

Thank you Corey for your advise, I see which links it is in google webmasters and in , but I can't reproduce it and don't know whats the best way to fix it?

[Joseph-Green-SEO]

Thomas thank you so much for your advise, and  Keri thanks for offering help.

My problem is that when I try to reproduce the 500 error so the host cant help me on how to fix it.

Any help?

[BlueprintMarketing]

Hey Keri how are you merry Christmas, I believe that 500 errors are almost always server related errors and unless he tells me about the host or Some other maybe strange unique problem with the computers registry I don't have enough to go on. You be interesting to find out what it is all the best, Tom

[KeriMorgret]

Hi Yoseph,

Did you get this figured out, or would you still like some assistance?

[CoreyNorthcutt]

HTTP Error 500 is an Internal Server Error.  It's a server-side error, that means there's either a problem with your web server or the code that it's trying to interpret.  It may not happen in 100% of scenarios, so you may not always see it happening yourself, but it prevents the page from loading.  Obviously, that's bad for search engines and users.

Your best bet in tracking down this error would be to go through your web server's error logs.  Or, if you can replicate this happening on the web, you could enable error reporting, and see what errors pop up there.  That should tell you how to fix the issue, whatever it may be.

[BlueprintMarketing]

I have googled it for you and I definitely think you should contact your web host. Here's what comes up https://my.bluehost.com/cgi/help/594

[BlueprintMarketing]

go into the campaign section on seomoz run your site through it. You will then see where the errors are upon seeing error lit up click it use the drop-down to select 500 errors then you will see exactly what link is causing the error.

There is literally no way I can guess what is causing your website guess not to work correctly however a 500 error is a very serious one most likely involving a problem with server.

If you give me your domain I might be able to help more however if your site is just giving 500 errors you might want to call your web host as it sounds like it is not an SEO problem is much as it is a hosting issue.