How do you find the source of a 404
-
I've recently noticed quite a sharp rise in the number of 404 errors on our site. Unsurprising really as we have just had a major upgrade of our site navigation. When looking in GA at the landing page stats the vast majority of them are from Google organic search. How do I find the source of the 404?
All help appreciated.
Thanks.
Jon
-
Try Open site explorer and "link opportunities" for any pages that are 404 and have external links. Webmaster tools will also show you pages that are 404 that have external links (though it doesn't show you the links) and Ahrefs has a similar tool
-
But that are only the internal sources...? Not?
-
For the quickness/effectiveness it would be, these in order:
1. Xenu
2. Screaming Frog
3. 404 Redirected Plugin (if you are using Wordpress)
Also once done also check with Google Webmaster tools and Moz tools to see if you caught all of them, this also takes a bit longer to update, thats why I listed it here, but you can also start with theses as well. If these campaigns/profiles are setup.
-
The Moz crawl will also identify 404s for you, and when you download the CSV, you can see the source of the 404.
-
http://www.screamingfrog.co.uk- is a great bit of software or Xenu
They are free and can tell you 404 etc. on your page and you can 301 from there.
-
Make sure you have google webmaster tools installed. On your dashboard, it will tell you if there are any crawl errors, click here to see where they are. Click on each link and it will give you the location of the URL and which pages are linking to it.
A quick solution would be to create 301 redirects for each page in your htaccess. However, it may be better in the long term to find all the pages linking to the missing pages and re-write them.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Using two 404 NOT FOUND pages
Hi all, I was wondering if any of you can advise whether it's no issue to use two separate custom 404 pages. The 404 pages would be different for different parts of the site. For instance, if you're on /community/ and you enter a non-existing page on: www.sample.com/community/example/ it would give you a different 404 page than someone who runs into a non existing page at: www.sample.com/definition/example/ Does anybody have experience with this and would this be fine?
Intermediate & Advanced SEO | | RonFav0 -
Cannot find reason for drop in ranking
One of our clients is a lingerie retailer, that also sells swimwear and nightwear. They have a webshop, with landing pages such as /lingerie, /swimwear and /nightwear (only in Dutch). The nightwear page is doing ok (#5 in Google NL), but for the swimwear and lingerie pages, something strange has happened and I have no clue what it is. On May 7, the /swimwear page ranked 24 for swimwear in Google NL. In that period, the homepage was ranking at #40-50. One week later, on May 14, the homepage was ranked 24 for swimwear, and the /swimwear page was nowhere to be found. The homepage is currently ranking 17/18 for swimwear. Something similar seems to have happened for lingerie. The homepage was ranking at around 11-13 for a few weeks in April/May, the /lingerie page was ranking at 8 in May, and then after the 4th of June, both the homepage and the /lingerie page no longer seem to have any decent rank for lingerie. So, trying to find the problem: I checked the Moz On-Page Grader for all three pages/keywords. All pages get an A. Robots.txt hardly contains anything, and there's no robots meta tag to block the page. Checked Google Webmaster Tools just in case, nothing out of the ordinary. The page contains 342 URL's which is a lot, but that shouldn't be too problematic, I thought? I used the Moz Keyword Difficulty Tool to analyze the current top 10 for lingerie, and compared it to our client's stats. Page Authority in the top 10 is 37-68, our clients is 33. Domain Authority in the top 10 is 27-100 (wiki page), our clients is 43. MozRank for the top 10 is 6,6-8,0, our clients is 6,7. MozTrust for the top 10 is 7,0-7,1, our clients is 7,0. The basics all look fine! Now, the page could use some link building, the number of links is a little low compared to the top 10 entries. We're also in the process of redesigning the page, adding more products but also more content (text and images) to inspire visitors a little more. But being low on links doesn't seem a good explanation for such a relatively sudden change in ranking. As far as we can tell, looking back at commits by our developers, nothing changed around that time that could have this impact. Of course it's possible that we missed something, we're still looking. Also, it's strange that these sudden changes took place for swimwear and especially lingerie, but not for nightwear. I'd really appreciate any tips, hints etc. to find out what's going on here. Thanks in advance! Michel
Intermediate & Advanced SEO | | DocdataCommerce0 -
404 ? 301 ? What is your opinion ?
Hi, I have a classifieds website and I am wondering about the life of a page with an ad. An announcement has therefore a limited life, so : Is a 404 pages? a 301 redirect to the section? let the content without redirection? What is your opinion? Sorry for my english, i'm french 😉 Thanks. A.
Intermediate & Advanced SEO | | android_lyon0 -
Is my text readable? I don't see it in the page source
Text on my site seems to be readable in a text only version (the page is not cached so I viewed it by disabling JAVA and then copy and pasted the page into Word) However, when I look in the page source I don't see the text there. The text was created using Open X html boxes to help us with formatting, but is this causing an SEO problem?
Intermediate & Advanced SEO | | theLotter0 -
Do 404 Pages from Broken Links Still Pass Link Equity?
Hi everyone, I've searched the Q&A section, and also Google, for about the past hour and couldn't find a clear answer on this. When inbound links point to a page that no longer exists, thus producing a 404 Error Page, is link equity/domain authority lost? We are migrating a large eCommerce website and have hundreds of pages with little to no traffic that have legacy 301 redirects pointing to their URLs. I'm trying to decide how necessary it is to keep these redirects. I'm not concerned about the page authority of the pages with little traffic...I'm concerned about overall domain authority of the site since that certainly plays a role in how the site ranks overall in Google (especially pages with no links pointing to them...perfect example is Amazon...thousands of pages with no external links that rank #1 in Google for their product name). Anyone have a clear answer? Thanks!
Intermediate & Advanced SEO | | M_D_Golden_Peak0 -
How do you find synonyms for a word in Google?
Hi, How would you go about finding a connection between words in the eyes of Google? So for example if I enter ~shoes -shoes I get a few things turn up in bold. Boots is one which makes sense and I would assume Google makes a connection between the words so using both in content would help semantically. BUT the other word it bolds is Store - this is where I get lost why would it make this connection unless Google is taking actual query data from users and making a different type of connection between words. How do you find a solid connection between words?
Intermediate & Advanced SEO | | Bondara0 -
Do 410 show in the 404 not found section in Google Webmaster Tools?
Question: Do 410 show in the 404 not found section in Google Webmaster Tools? Specific situation: We got rid of an entire subdomain except for a few pages that we 301'd to relevant content on our main domain. The rest return a 404 not found. These show up in our google webmaster tools as crawl errors. I was wondering since 410 is a content gone error and we intentionally want this content gone, if we switch it to 410, does Google still report it as a 404 error? Thanks
Intermediate & Advanced SEO | | MarloSchneider0 -
Wordpress No 404
Hello, My issue is that in wordpress 404 does not seem to be working properly. An example of this is: sitename.com/category/catname loads the files in that category but I can also type sitename.com/category/asdasfaasd/catname and it still goes to the posts in that category and does not 404. I can replace the misc text with anything and it does not 404. My worry is that this can be used to exploit duplicate content. I've looked at a couple of other sites and they do the same. I'm using Yoast as my SEO plugin and my theme is elogix from themeforest. I've tried disabling all plugins, cloudflare and changing theme and the same issue exists. If anyone can help it would be extremely appreciated.
Intermediate & Advanced SEO | | LukeHutchinson0