404 Best Practices
-
Hello All,
So about 2 months ago, there was a massive spike in the number of crawl errors on my site according to Google Webmaster tools.
I handled this by sending my webmaster a list of the broken pages with working pages that they should 301 redirect to.
Admittedly, when I looked back a couple weeks later, the number had gone down only slightly, so I sent another list to him (I didn't realize that you could 'Mark as fixed' in webmaster tools)
So when I sent him more, he 301 redirected them again (with many duplicates) as he was told without really digging any deeper.
Today, when I talked about more re-directs, he suggested that 404's do have a place, that if they are actually pages that don't exist anymore, then a ton of 301 re-directs may not be the answer.
So my two questions are:
1. Should I continue to relentlessly try to get rid of all 404's on my site, and if so, do I have to be careful not to be lazy and just send most of them to the homepage.
2. Are there any tools or really effective ways to remove duplicate 301 redirect records on my .htaccess (because the size of it at this point could very well be slowing down my site).
Any help would be appreciated, thanks
-
Thanks for the question.
Just to add to what the other guys have said, here is a helpful article from Google which explains a bit more about their stance on 404s.
In general, you should try to 301 redirect 404 errors to other pages if it makes sense for the user. For example, if a 404 page is an article about belgian beers, you could redirect that to another article about belgian beers so that the user lands on a relevant page. You should definitely try to avoid mass redirecting links to your homepage because Google can treat these as 404s - there is a video here on the topic:
http://www.davidsottimano.com/internal-301-homepage-treated-404-google/
If a page 404s and can't be redirected to a relevant page, then it's best to leave it as a 404 and let Google keep crawling it.
I also agree with the other guys on creating a custom 404 page which will provide a good user experience if they happen to land on it.
-
As far as the Google Webmaster is concern it usually take a bit of time to get updated especially when it comes to 404 pages so soul trust on this one tool will be dangerous. I prefer using screaming frog to see the current situation of the website as their audit is based on the current website condition.
I do agree with Jesse that 404s do have a place and they can exist but the problem starts when any of the 404 page either contain good amount of link juice or traffic landing on those pages. In order to save your link juice and positional traffic you have to land them to a page that actually exist and can entertain your traffic well so that is why we recommend using 301 to page that can entertain will and full fill user’s expectation.
I will also suggest you to create a custom 404 page that helps people move to different areas of the website.
Hope this helps
-
The error that is most problematic is when you have 404 pages that you are linking to internally and/or are found in your site map. Google reporting that an external site is linking to a 404 page isn't as damaging. If it truly is an error then a 404 is okay to have, but not preferable. If the page linking to you made an error, it would be preferable to seek out the owner of that page and ask them to fix it. However, if you can't reach the owner and if the referring website is a valuable traffic source and/or that link juice is important then, yes, add a 301 redirect.
-
It's true that 404s have a place and can exist just fine so long as people aren't landing on them. Think of it from a usability standpoint; if the link exists somewhere on a foreign domain and is pointing to your site, you should 301 it. That way if somebody clicks it they don't get dropped into 404-hell.
Otherwise don't worry about it. Google will eventually stop looking at pages that 404. They're only notifying you in case it was a mistake and you want to capture a potential audience that is coming through that link.
Best practice is to 301 broken links if they receive traffic or have some link juice you aren't interested in losing. Also be sure and create a custom 404 page for any that you may miss out there so that at least the person arrives on a page branded by you with easily accessible links to find what they might be looking for.
Not sure about multiple 301s in an htaccess file (I'm more accustomed to an IIS server) but my guess would be that it shouldn't matter. They aren't pointing to different places and crossing back to eachother so you are in no danger of a redirect loop. I would imagine the spiders will follow one of them and ignore the others.
Hope this helps and good luck!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Best way to deal with 100 product pages
It feels good to be BACK. I miss Moz. I left for a long time but happy to be back! 🙂 My client is a local HVAC company. They sell Lennox system. Lennox provides a tool that we hooked up to that allows visitors to their site to 'see' 120+ different kind of air quality, furnace and AC units. They problem is (I think its a problem) is Google and other crawl tools are seeing these 100+ pages that are not unique, helpful or related to my client. There is a little bit of cookie cutter text and images and specs and that's it. Are these pages potentially hurting my client? I can't imagine they are helping. Best way to deal with these? Thank you! Thank you! Matthew
Technical SEO | | Localseo41440 -
404 errors
Hi I am getting these show up in WMT crawl error any help would be very much appreciated | ?escaped_fragment=Meditation-find-peace-within/csso/55991bd90cf2efdf74ec3f60 | 404 | 12/5/15 |
Technical SEO | | ReSEOlve
| | 2 | mobile/?escaped_fragment= | 404 | 10/26/15 |
| | 3 | ?escaped_fragment=Tips-for-a-balanced-lifestyle/csso/1 | 404 | 12/1/15 |
| | 4 | ?escaped_fragment=My-favorite-yoga-spot/csso/5598e2130cf2585ebcde3b9a | 404 | 12/1/15 |
| | 5 | ?escaped_fragment=blog/c19s6 | 404 | 11/29/15 |
| | 6 | ?escaped_fragment=blog/c19s6/Tag/yoga | 404 | 11/30/15 |
| | 7 | ?escaped_fragment=Inhale-exhale-and-once-again/csso/2 | 404 | 11/27/15 |
| | 8 | ?escaped_fragment=classes/covl | 404 | 10/29/15 |
| | 9 | m/?escaped_fragment= | 404 | 10/26/15 |
| | 10 | ?escaped_fragment=blog/c19s6/Page/1 | 404 | 11/30/15 | | |0 -
Soft 404 errors
Google webmaster tools is telling me I have 8 "soft 404's". They are all like this page...
Technical SEO | | sdwellers
http://www.seadwellers.com/search/page/8/ All 8 pages are the same except the number at the end...... I just can't figure this....any insight at all is appreciated and do i need to correct somehow?0 -
Find all 404 links in my site that are indexed
Hi All, Find all 404 links in my site that are indexed. We deleted a lot of URl's from site but now i dont have the track of all we deleted. Any site/Tool can scan the index and give me the exact URL's so I can use https://www.google.com/webmasters/tools/removals?hl=en&rlf=all Regards Martin
Technical SEO | | mtthompsons0 -
What is the best strategy for a company in various countries?
Hello I have to make yt SEO marketing strategy for a company that provides services in Spain, Colombia and Mexico
Technical SEO | | interficto
I'm looking at two options: Buy different domains (TLD): This option seems feasible but very expensive and manage each domain position it would have to have different content in each (plus you would not know that because it is put exactly the same domain) Place each service and country folders eg
www.dominio.com / mexico / training-financiero.html
www.dominio.com / espana / training-financiero.html I have understood that option 1 is no longer necessary since you can use html tags within the code to tell Google that you try to target content to customers from a different country.
In principle we would use the same content would change only a few words and of course the currency to suit the local currency of each country. However I believe that customers could rely more on a domain if their country. Plus I'm afraid I google indexed as duplicate content is another matter What country would main that could confuse the visitor?0 -
"/blogroll" causing 404 error
I'm running a campaign, and the crawling report for my site returned a lot of 4xx errors. When I look at the URLs, they all have a "/blogroll" in the end, like: mysite.com/post-number-1/blogroll mysite.com/post-number-2/blogroll And so on, for pretty much all the pages. The thing is, I removed the blogroll widget completely, so I really wouldn't know what can possibly point to links like that. Is there anything to fix on the site? Thanks
Technical SEO | | Baffo0 -
Index page 404 error
Crawl Results show there is 404 error page which is index.htmk **it is under my root, ** http://mydomain.com/index.htmk I have checked my index page on the server and my index page is index.HTML instead of index.HTMK. Please help me to fix it
Technical SEO | | semer0 -
Internal vs external blog and best way to set up
I have a client that has two domians registered - one uses www.keywordaustralia.com the other uses www.keywordaelaide.com He had already bought and used the first domain when he came to me I suggested the second as being worth buying as going for a more local keyword would be more appropriate. Now I have suggested to him that a blog would be a worthy use of the second domain and a way to build links to his site - however I am reading that as all links will be from the same site it wont be worth much in the long run and an internal blog is better as it means updated content on his site. should i use the second domain for blog, or just 301 the second domain to his first domain. Or is it viable to use the second domain as the blog and just set up an rss feed on his page ? Is there a way to have the second domain somehow 'linked' to his first domain with the blog so that google sees them as connected ? NOOBIE o_0
Technical SEO | | mamacassi0