How do you find the source of a 404
-
I've recently noticed quite a sharp rise in the number of 404 errors on our site. Unsurprising really as we have just had a major upgrade of our site navigation. When looking in GA at the landing page stats the vast majority of them are from Google organic search. How do I find the source of the 404?
All help appreciated.
Thanks.
Jon
-
Try Open site explorer and "link opportunities" for any pages that are 404 and have external links. Webmaster tools will also show you pages that are 404 that have external links (though it doesn't show you the links) and Ahrefs has a similar tool
-
But that are only the internal sources...? Not?
-
For the quickness/effectiveness it would be, these in order:
1. Xenu
2. Screaming Frog
3. 404 Redirected Plugin (if you are using Wordpress)
Also once done also check with Google Webmaster tools and Moz tools to see if you caught all of them, this also takes a bit longer to update, thats why I listed it here, but you can also start with theses as well. If these campaigns/profiles are setup.
-
The Moz crawl will also identify 404s for you, and when you download the CSV, you can see the source of the 404.
-
http://www.screamingfrog.co.uk- is a great bit of software or Xenu
They are free and can tell you 404 etc. on your page and you can 301 from there.
-
Make sure you have google webmaster tools installed. On your dashboard, it will tell you if there are any crawl errors, click here to see where they are. Click on each link and it will give you the location of the URL and which pages are linking to it.
A quick solution would be to create 301 redirects for each page in your htaccess. However, it may be better in the long term to find all the pages linking to the missing pages and re-write them.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
How to Rank for "Interesting Finds" on Google Mobile?
Hi! Some of the sites I work with, when doing searches for their top terms, I am seeing some articles listed under "Interesting Finds". I have read some people thought it deals with AMP, others do not. Some thing it has to do with the structured data added to the page, some do not. Does anyone have a definitive answer on how to increase your chances of being listed here? Any example is attached. Any ideas? Uoi4Jyh
Intermediate & Advanced SEO | | vetofunk0 -
Search engine simulators are not finding text on my website. Do I have a problem with Javascript or AJAX?
My website text is not appearing in search engine simulators. Is there a problem with the javascript? Or perhaps AJAX is affecting it? Is there a tool I can use to examine how my website architecture is affecting how the site is crawled? I am totally lost. Help!
Intermediate & Advanced SEO | | ecigseo0 -
How to identify 404 that get links from external sites (but not search engines)?
one of our site had a poor site architecture causing now about 10.000s of 404 being currently reported in google webmaster tools. Any idea about easily detecting among these thousands of 404, which ones are coming from links from external websites (so filtering out 404 caused by links from our own domain and 404 from search engines)? crawl bandwidth seems to be an issue on this domain. Anything that can be done to accelerate google removing these 404 pages from their index? Due to number of 404 manual submission in google wbt one by one is not an option.
Intermediate & Advanced SEO | | lcourse
Or do you believe that google automatically will stop crawling these 404 pages within a month or so and no action needs to be taken? thanks0 -
Should I remove 404 urls in webmaster tools?
I've recently removed a lot of category pages so should I remove the urls in webmaster tools or let them drop out of the index naturally?
Intermediate & Advanced SEO | | SamCUK0 -
Wordpress No 404
Hello, My issue is that in wordpress 404 does not seem to be working properly. An example of this is: sitename.com/category/catname loads the files in that category but I can also type sitename.com/category/asdasfaasd/catname and it still goes to the posts in that category and does not 404. I can replace the misc text with anything and it does not 404. My worry is that this can be used to exploit duplicate content. I've looked at a couple of other sites and they do the same. I'm using Yoast as my SEO plugin and my theme is elogix from themeforest. I've tried disabling all plugins, cloudflare and changing theme and the same issue exists. If anyone can help it would be extremely appreciated.
Intermediate & Advanced SEO | | LukeHutchinson0 -
Why do pages with a 404 error drop out of webmaster tools only to reappear again?
I have noticed a lot of pages which have fallen out of webmaster tools crawl error log that had bee 404'ing are reappearing again Any suggestions as to why this might be the case? How can I make sure they don't reappear again?
Intermediate & Advanced SEO | | Towelsrus0 -
Best way to find broken links on a large site?
I've tried using Xenu, but this is a bit time consuming because it only tells you if the link sin't found & doesn't tell you which pages link to the 404'd page. Webmaster tools seems a bit dated & unreliable. Several of the links it lists as broken aren't. Does anyone have any other suggestions for compiling a list of broken links on a large site>
Intermediate & Advanced SEO | | nicole.healthline1 -
Best way to find all url parameters?
In reference to http://googlewebmastercentral.blogspot.com/2011/07/improved-handling-of-urls-with.html, what is the best way to find all of the parameters that need to be addressed? Thanks!
Intermediate & Advanced SEO | | nicole.healthline0