How do you find the source of a 404
-
I've recently noticed quite a sharp rise in the number of 404 errors on our site. Unsurprising really as we have just had a major upgrade of our site navigation. When looking in GA at the landing page stats the vast majority of them are from Google organic search. How do I find the source of the 404?
All help appreciated.
Thanks.
Jon
-
Try Open site explorer and "link opportunities" for any pages that are 404 and have external links. Webmaster tools will also show you pages that are 404 that have external links (though it doesn't show you the links) and Ahrefs has a similar tool
-
But that are only the internal sources...? Not?
-
For the quickness/effectiveness it would be, these in order:
1. Xenu
2. Screaming Frog
3. 404 Redirected Plugin (if you are using Wordpress)
Also once done also check with Google Webmaster tools and Moz tools to see if you caught all of them, this also takes a bit longer to update, thats why I listed it here, but you can also start with theses as well. If these campaigns/profiles are setup.
-
The Moz crawl will also identify 404s for you, and when you download the CSV, you can see the source of the 404.
-
http://www.screamingfrog.co.uk- is a great bit of software or Xenu
They are free and can tell you 404 etc. on your page and you can 301 from there.
-
Make sure you have google webmaster tools installed. On your dashboard, it will tell you if there are any crawl errors, click here to see where they are. Click on each link and it will give you the location of the URL and which pages are linking to it.
A quick solution would be to create 301 redirects for each page in your htaccess. However, it may be better in the long term to find all the pages linking to the missing pages and re-write them.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Why are these pages showing up as 404 in Search Console?
This page is showing up as a 404 in Google Search console- https://www.wolfautomation.com/blog/autonics/ It shows it has been linked from these pages- https://www.wolfautomation.com/blog/raffel/ https://www.wolfautomation.com/blog/new-temperature-controllers-from-autonics/ https://www.wolfautomation.com/blog/ge-industrial/ https://www.wolfautomation.com/blog/temp-controller/ https://www.wolfautomation.com/blog/tx4s/ I never created this page, I don't want this page but it keeps showing up. The problem is the link isn't found on those pages anywhere so I can't delete it. What am I missing? How can I get rid of it?
Intermediate & Advanced SEO | | Tylerj0 -
Keyword Spy Source?
We've got a few backlinks from Keyword Spy and Keyword Spy Pro. I'm pretty sure of the answer but I'll ask it anyway. Is there any way to determine who's doing the snooping? Are there any signals to look for while clicking back through the link "crumbs" that might tell me something of interest or value?
Intermediate & Advanced SEO | | AWCthreads0 -
Better to re-direct to a completely un-related page or 404?
We have about 1000 pages we need to eliminate from our site (of about 18000 URLs). these URLs don't see a ton of traffic, but may have some valuable links. Would we be better to 404 these or re-direct them to our homepage? Could re-directing to our homepage hurt us?
Intermediate & Advanced SEO | | nicole.healthline0 -
redirect 404 pages to homepage
Hello, I'm puting a new website on a existing domain. In order to not loose the links that point to the varios old url I would like to redirect them to homepage. The old website was a mess as there was no seo and the pages didn't target any keywords. Thats why I would like to redirect all links to home. What do you think is the best way to do this ? I tried to ad this in the .htaccess but it's not working; ErrorDocument 404 /index.php Con you tell me how it exacly look? Now the hole file is like this: @package Joomla @copyright Copyright (C) 2005 - 2012 Open Source Matters. All rights reserved. @license GNU General Public License version 2 or later; see LICENSE.txt READ THIS COMPLETELY IF YOU CHOOSE TO USE THIS FILE! The line just below this section: 'Options +FollowSymLinks' may cause problems with some server configurations. It is required for use of mod_rewrite, but may already be set by your server administrator in a way that dissallows changing it in your .htaccess file. If using it causes your server to error out, comment it out (add # to beginning of line), reload your site in your browser and test your sef url's. If they work, it has been set by your server administrator and you do not need it set here. Can be commented out if causes errors, see notes above. Options +FollowSymLinks Mod_rewrite in use. RewriteEngine On Begin - Rewrite rules to block out some common exploits. If you experience problems on your site block out the operations listed below This attempts to block the most common type of exploit attempts to Joomla! Block out any script trying to base64_encode data within the URL. RewriteCond %{QUERY_STRING} base64_encode[^(]([^)]) [OR] Block out any script that includes a
Intermediate & Advanced SEO | | igrizo0 -
Hundreds of thousands of 404's on expired listings - issue.
Hey guys, We have a conundrum, with a large E-Commerce site we operate. Classified listings older than 45 days are throwing up 404's - hundreds of thousands, maybe millions. Note that Webmaster Tools peaks at 100,000. Many of these listings receive links. Classified listings that are less than 45 days show other possible products to buy based on an algorithm. It is not possible for Google to crawl expired listings pages from within our site. They are indexed because they were crawled before they expired, which means that many of them show in search results. -> My thought at this stage, for usability reasons, is to replace the 404's with content - other product suggestions, and add a meta noindex in order to help our crawl equity, and get the pages we really want to be indexed prioritised. -> Another consideration is to 301 from each expired listing to the category heirarchy to pass possible link juice. But we feel that as many of these listings are findable in Google, it is not a great user experience. -> Or, shall we just leave them as 404's? : google sort of says it's ok Very curious on your opinions, and how you would handle this. Cheers, Croozie. P.S I have read other Q & A's regarding this, but given our large volumes and situation, thought it was worth asking as I'm not satisfied that solutions offered would match our needs.
Intermediate & Advanced SEO | | sichristie0 -
301 or 404?
My client has a classified ads website with hundreds of thousands of classified ads. These ads expire quite fast. When the ad expires it gets removed. At the moment this results in a 404 page and thus hundreds of thousands of 404 erros in Webmasters Tools. From what I know this damages SERP results due to slow indexing of important sites and 404 being just plain bad SEO. I suggested doing a 301 from the expired ads to a upper category but this feels like cheating. The content hasn't actually moved, it has been removed. What would you suggest?
Intermediate & Advanced SEO | | PanuKuuluvainen0