404 Best Practices
-
Hello All,
So about 2 months ago, there was a massive spike in the number of crawl errors on my site according to Google Webmaster tools.
I handled this by sending my webmaster a list of the broken pages with working pages that they should 301 redirect to.
Admittedly, when I looked back a couple weeks later, the number had gone down only slightly, so I sent another list to him (I didn't realize that you could 'Mark as fixed' in webmaster tools)
So when I sent him more, he 301 redirected them again (with many duplicates) as he was told without really digging any deeper.
Today, when I talked about more re-directs, he suggested that 404's do have a place, that if they are actually pages that don't exist anymore, then a ton of 301 re-directs may not be the answer.
So my two questions are:
1. Should I continue to relentlessly try to get rid of all 404's on my site, and if so, do I have to be careful not to be lazy and just send most of them to the homepage.
2. Are there any tools or really effective ways to remove duplicate 301 redirect records on my .htaccess (because the size of it at this point could very well be slowing down my site).
Any help would be appreciated, thanks
-
Thanks for the question.
Just to add to what the other guys have said, here is a helpful article from Google which explains a bit more about their stance on 404s.
In general, you should try to 301 redirect 404 errors to other pages if it makes sense for the user. For example, if a 404 page is an article about belgian beers, you could redirect that to another article about belgian beers so that the user lands on a relevant page. You should definitely try to avoid mass redirecting links to your homepage because Google can treat these as 404s - there is a video here on the topic:
http://www.davidsottimano.com/internal-301-homepage-treated-404-google/
If a page 404s and can't be redirected to a relevant page, then it's best to leave it as a 404 and let Google keep crawling it.
I also agree with the other guys on creating a custom 404 page which will provide a good user experience if they happen to land on it.
-
As far as the Google Webmaster is concern it usually take a bit of time to get updated especially when it comes to 404 pages so soul trust on this one tool will be dangerous. I prefer using screaming frog to see the current situation of the website as their audit is based on the current website condition.
I do agree with Jesse that 404s do have a place and they can exist but the problem starts when any of the 404 page either contain good amount of link juice or traffic landing on those pages. In order to save your link juice and positional traffic you have to land them to a page that actually exist and can entertain your traffic well so that is why we recommend using 301 to page that can entertain will and full fill user’s expectation.
I will also suggest you to create a custom 404 page that helps people move to different areas of the website.
Hope this helps
-
The error that is most problematic is when you have 404 pages that you are linking to internally and/or are found in your site map. Google reporting that an external site is linking to a 404 page isn't as damaging. If it truly is an error then a 404 is okay to have, but not preferable. If the page linking to you made an error, it would be preferable to seek out the owner of that page and ask them to fix it. However, if you can't reach the owner and if the referring website is a valuable traffic source and/or that link juice is important then, yes, add a 301 redirect.
-
It's true that 404s have a place and can exist just fine so long as people aren't landing on them. Think of it from a usability standpoint; if the link exists somewhere on a foreign domain and is pointing to your site, you should 301 it. That way if somebody clicks it they don't get dropped into 404-hell.
Otherwise don't worry about it. Google will eventually stop looking at pages that 404. They're only notifying you in case it was a mistake and you want to capture a potential audience that is coming through that link.
Best practice is to 301 broken links if they receive traffic or have some link juice you aren't interested in losing. Also be sure and create a custom 404 page for any that you may miss out there so that at least the person arrives on a page branded by you with easily accessible links to find what they might be looking for.
Not sure about multiple 301s in an htaccess file (I'm more accustomed to an IIS server) but my guess would be that it shouldn't matter. They aren't pointing to different places and crossing back to eachother so you are in no danger of a redirect loop. I would imagine the spiders will follow one of them and ignore the others.
Hope this helps and good luck!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
What IS SEO FRIENDLY BEST PRACTICE FOR URLS FILTERED 'TAGGED'
EX: https://www.STORENAME.com/collections/all-deals/alcatel– Tagged "Alcatel", when I run audits, I come across these URLS that give me duplicate content and missing H1. This is Canonical: https://www.STORENAMEcom/collections/all-deals/alcatel Any advice on how to tackle these I have about4k in my store! Thank you
Technical SEO | | Sscha0030 -
Best Nofollow Practice Facing +500 instances of affiliate links
Hi. I have a set of affiliate links on my website. That's 50 unique links in total. They are placed in a separate folder /go/, and are all nofollowed. My website has 100 pages. When doing a site audit I get a report with 50 affiliate links pr. page x100. That's a huge report. Is this really necessary? I can ofc. choose to ignore the automated reports, but I can't help but to think that there must be an easier way to keep track of it? Like, if Link 1-50 is located in /go/, they should automatically be nofollowed, regardless of where they are located on the root/sub domain. Bonus question: The format of the link is https://exampledomain.com/go/brandname I am wondering if I should add that "/" at the end of it. If yes, why? If no, why?
Technical SEO | | Dan-Louis0 -
Search pages showing up as soft 404 in WMT
Hi ....we are getting allot of "site search" pages showing up in wmt as soft 404's and wanted to know what the best would be to stop this. All search pages are already noindex follow but maybe we should block them in robots txt as well. Would the below help to solve this ? User-agent: *
Technical SEO | | nomad-202323
Disallow: /?s=
Disallow: /search/ Any other suggestions or direction would be appreciated to prevent these pages showing up as soft 404's tks0 -
Redirects - How Best to do this ?
Hi I am looking to close Website A which has many pages. I would like to keep the home page and add some great content to it with a link pointing to Website B. As for all the other pages excluding the home page , how is it best to approach them on Website A. Should I redirect them all to the home page of Website A which will tell Google thoose Pages are no longer needed and to prevent the visitors from seeing a 404? My Main aim here is to not lose any visitors to Website A by sending them to Website B but also to hopefully pass any Page strength from Website A to Website B Thanks Adam
Technical SEO | | AMG1000 -
Backlinks that we have if they are 404?
Hi All, Backlinks that we have if they are 404? Open site explorer shows 1,000 of links and when I check many are 404 and those are spammy links which we had but now the sites are 404 I am doing a link profile check which is cleaning up all spammy links Should i take any action on them? As open site explorer or Google still shows these links on the searches. Should we mention these URL's in disallow in Google webmaster. Thanks
Technical SEO | | mtthompsons0 -
Google showing a Cached option but then giving a 404
2 weeks ago my home page plus some others had a 301 redirect to another domain for about 1 week (due to a hack).The original pages were then de-indexed and the new bad domain was indexed and in effect stole my rankings.Then the 301 was removed/cleaned from my domain and the bad domain was fully de-indexed via a request I made (this was 1 week ago).Then my pages came back into the index but without any ranking power.Now when I perform a search for my domain my home page is listed with an option to view the Cache. Clicking on the Cache brings up a 404 error.So why is Google showing the Cached option but doesn't have the cached file? How do I get Google to properly update it's Cache or show a cached copy?
Technical SEO | | Dantek0 -
404 Error from site - is this normal?
I have been trying to clean up any 404 errors. We keep getting the following: URL /include/vdimgck.php referring domain http://www.856d.c@m/plus/feedback.php rendered domain unclickable by adding the "@" since I do not know if it is safe. I just turned off the trackbacks and pings in the blog since I saw it was producing duplicate content and from what I read it is not worth keeping those with Wordpress. is vdimgck.php anything some here instantly recognizes ? It tops all our 404 errors, seems like a lot of requests. Thanks!
Technical SEO | | Force70 -
Best Practice to Remove a Blog
Note: Re-posting since I accidentally marked as answered Hi, I have a blog that has thousands of URL, the blog is a part of my site. I would like to obsolete the blog, I think the best choices are 1. 404 Them: Problem is a large number of 404's. I know this is Ok, but makes me hesitant. 2. meta tag no follow no index. This would be great, but the question is they are already indexed. Thoughts? Thanks PS A 301 redirect to the main page would be flagged as a soft 404
Technical SEO | | Bucky0