404 Best Practices
-
Hello All,
So about 2 months ago, there was a massive spike in the number of crawl errors on my site according to Google Webmaster tools.
I handled this by sending my webmaster a list of the broken pages with working pages that they should 301 redirect to.
Admittedly, when I looked back a couple weeks later, the number had gone down only slightly, so I sent another list to him (I didn't realize that you could 'Mark as fixed' in webmaster tools)
So when I sent him more, he 301 redirected them again (with many duplicates) as he was told without really digging any deeper.
Today, when I talked about more re-directs, he suggested that 404's do have a place, that if they are actually pages that don't exist anymore, then a ton of 301 re-directs may not be the answer.
So my two questions are:
1. Should I continue to relentlessly try to get rid of all 404's on my site, and if so, do I have to be careful not to be lazy and just send most of them to the homepage.
2. Are there any tools or really effective ways to remove duplicate 301 redirect records on my .htaccess (because the size of it at this point could very well be slowing down my site).
Any help would be appreciated, thanks
-
Thanks for the question.
Just to add to what the other guys have said, here is a helpful article from Google which explains a bit more about their stance on 404s.
In general, you should try to 301 redirect 404 errors to other pages if it makes sense for the user. For example, if a 404 page is an article about belgian beers, you could redirect that to another article about belgian beers so that the user lands on a relevant page. You should definitely try to avoid mass redirecting links to your homepage because Google can treat these as 404s - there is a video here on the topic:
http://www.davidsottimano.com/internal-301-homepage-treated-404-google/
If a page 404s and can't be redirected to a relevant page, then it's best to leave it as a 404 and let Google keep crawling it.
I also agree with the other guys on creating a custom 404 page which will provide a good user experience if they happen to land on it.
-
As far as the Google Webmaster is concern it usually take a bit of time to get updated especially when it comes to 404 pages so soul trust on this one tool will be dangerous. I prefer using screaming frog to see the current situation of the website as their audit is based on the current website condition.
I do agree with Jesse that 404s do have a place and they can exist but the problem starts when any of the 404 page either contain good amount of link juice or traffic landing on those pages. In order to save your link juice and positional traffic you have to land them to a page that actually exist and can entertain your traffic well so that is why we recommend using 301 to page that can entertain will and full fill user’s expectation.
I will also suggest you to create a custom 404 page that helps people move to different areas of the website.
Hope this helps
-
The error that is most problematic is when you have 404 pages that you are linking to internally and/or are found in your site map. Google reporting that an external site is linking to a 404 page isn't as damaging. If it truly is an error then a 404 is okay to have, but not preferable. If the page linking to you made an error, it would be preferable to seek out the owner of that page and ask them to fix it. However, if you can't reach the owner and if the referring website is a valuable traffic source and/or that link juice is important then, yes, add a 301 redirect.
-
It's true that 404s have a place and can exist just fine so long as people aren't landing on them. Think of it from a usability standpoint; if the link exists somewhere on a foreign domain and is pointing to your site, you should 301 it. That way if somebody clicks it they don't get dropped into 404-hell.
Otherwise don't worry about it. Google will eventually stop looking at pages that 404. They're only notifying you in case it was a mistake and you want to capture a potential audience that is coming through that link.
Best practice is to 301 broken links if they receive traffic or have some link juice you aren't interested in losing. Also be sure and create a custom 404 page for any that you may miss out there so that at least the person arrives on a page branded by you with easily accessible links to find what they might be looking for.
Not sure about multiple 301s in an htaccess file (I'm more accustomed to an IIS server) but my guess would be that it shouldn't matter. They aren't pointing to different places and crossing back to eachother so you are in no danger of a redirect loop. I would imagine the spiders will follow one of them and ignore the others.
Hope this helps and good luck!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
What is the best practice for redirecting a lower authority TLD to a high authority TLD?
Hi there moz community! My organization is blessed with an extremely high authority TLD (91). Powers-that-be want to start using a lesser authority (though still a respectable 62) TLD in marketing materials because they think it's more memorable/less confusing for users. We currently have a 302 redirect in place from score-62 to score-91, and our situation relative to the engines is strong. However, if they ramp-up a branding campaign using the 62-score TLD, should we change the 302 to a 301? I don't want to risk infecting that 91 score with any juice relative to the score-62 TLD. There isn't a lot written for the best practice in redirecting a lower-authority TLD to a high authority TLD - almost all the literature is about preserving your score/juice when redirecting an old TLD to a new TLD. Thanks for anyone/everyone's help! Brian Alpert; Smithsonian Institution
Technical SEO | | Smithsonian1 -
Help: Blog post translations resulting in 404 Not Found?
A client set up a website that has multilingual functionality (WPML) and the back end is a bit of a mess. The site has around 6 translated versions of the 30 or so existing English blog posts in French, Italian and Spanish - all with their own URLs. The problem is that on the remaining 24 English blog posts, the language changer in the header is still there - even though the majority of posts have not been translated - so when you go to change the language to French, it adds **?lang=fr **onto the existing english URL, and is a page not found (4xx client error). I can't redirect anything because the page does not exist. Is there a way to stop this from happening? I have noticed it's also creating italian/french/spanish translation of the english Categories too. Thanks in advance.
Technical SEO | | skehoe0 -
Question on URL wording and structure best practices
We're mapping out some URL structures and trying to figure out what would be best for separating folders for articles and videos regarding wording in the folder say: www.site.com/category/article/name-of-article/id#/ ---- www.site.com/category/video/name-of-video/id#/ vs. www.site.com/category/a/name-of-article/id#/ ---- www.site.com/category/v/name-of-video/id#/ Second option came about the ''shorter is better' way of thinking. Downside I see to it is if the link would be copied and pasted somewhere probably would be best for a user to make it clear they are clicking into an article or a video, don't think just an 'a' or a 'v' would be very telling in that scenario. Would it be better for search engines to make it clearer with the whole word in there? Any other pros and cons to each? Not sure what's the best route here.
Technical SEO | | SBRMarketing0 -
Does 404 hurts my website.?
Does 404 hurts my website.? My website reporting 404 crawl errors on pages that have never been part of the website. Site showing lot of 404 errors and all errors from Blog.We didn't create any pages .Automatically pages are created and showing 404 (Not Found) error response..Please any one help me to identify those issues.?
Technical SEO | | nlogix0 -
Internal links best practices
In looking at the inbound links to a client’s Home page, I see that the link from each page of the website back to the Home page is an image, and the ALT text is “Home.” I have a few questions about this, and would appreciate help understanding best practices: --Does it matter that the link back to the Home page is an image (presumably the client’s logo)? -- If we keep the image link, wouldn’t it be better to use “client’s company name” as ALT text rather than “Home”? --Should I recommend using an HTML link back to the Home page, and using the company name as anchor text? (I don't think it's relevant, but the site is built in Drupal.) Thanks!
Technical SEO | | jrae0 -
OMG!! 1300 404 Errors. HELP ME!!!
Day by day google detecting 404 errors urls. Currently it is cross 1340 urls. Please help me to get out of this shit. You can check the screenshot here You can see the screenshot here- http://img856.imageshack.us/img856/429/954b503e0781462c8a15774.png Please check the website - www.plugnbuy.com Kindly help me. I use nofollow tag but still don't know why google detecting those errors.
Technical SEO | | chandubaba1 -
Best META Fields to Include on New Site
I am in the process of transitioning sites to a Drupal CMS and am curious to know what META information to provide on each of the new site pages. Currently, this is the set-up I plan on using: My questions to the community are: whether or not I've added all pertinent information, and if there's anything I'm overlooking
Technical SEO | | NiallSmith0 -
What is the best website structure for SEO?
I've been on SEOmoz for about 1 month now and everyone says that depending on the type of business you should build up your website structure for SEO as 1st step. I have a new client click here ( www version doesn't work)... some bugs we are fixing it now. We are almost finished with the design & layout. 2nd question have been running though my head. 1. What would the best url category for the shop be /products/ - current url cat ex: /products/door-handles.html 2. What would you use for the main menu as section for getting the most out of SEO. Personally i am thinking of making 2-3 main categories on the left a section where i can add content to it (3-4 paragraphs... images maybe a video).So the main page focuses on the domain name more and the rest of the sections would focus on specific keywords, this why I avoid cannibalization. Main keyword target is "door handles" Any suggestions would be appreciated.
Technical SEO | | mosaicpro0