How do you find the source of a 404
-
I've recently noticed quite a sharp rise in the number of 404 errors on our site. Unsurprising really as we have just had a major upgrade of our site navigation. When looking in GA at the landing page stats the vast majority of them are from Google organic search. How do I find the source of the 404?
All help appreciated.
Thanks.
Jon
-
Try Open site explorer and "link opportunities" for any pages that are 404 and have external links. Webmaster tools will also show you pages that are 404 that have external links (though it doesn't show you the links) and Ahrefs has a similar tool
-
But that are only the internal sources...? Not?
-
For the quickness/effectiveness it would be, these in order:
1. Xenu
2. Screaming Frog
3. 404 Redirected Plugin (if you are using Wordpress)
Also once done also check with Google Webmaster tools and Moz tools to see if you caught all of them, this also takes a bit longer to update, thats why I listed it here, but you can also start with theses as well. If these campaigns/profiles are setup.
-
The Moz crawl will also identify 404s for you, and when you download the CSV, you can see the source of the 404.
-
http://www.screamingfrog.co.uk- is a great bit of software or Xenu
They are free and can tell you 404 etc. on your page and you can 301 from there.
-
Make sure you have google webmaster tools installed. On your dashboard, it will tell you if there are any crawl errors, click here to see where they are. Click on each link and it will give you the location of the URL and which pages are linking to it.
A quick solution would be to create 301 redirects for each page in your htaccess. However, it may be better in the long term to find all the pages linking to the missing pages and re-write them.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
How to come back from reverse SEO penalization, and how to find out more about it?
Hello, We are currently researching the case of a client that suffered greatly after a campaign of reverse SEO. In a short spam of time (about 6 months) thousands of foul links were created pointing at this site, and as a consequence, it got an algorithmic penalization, and organic traffic dropped almost by half. Does anyone has any experience with this kind of situations we could learn from? Obviously, we are already proceeding to disavow such bad links, but we'd also love to get to know who is behind this. Is there any way of finding out who or what company originated these links. Many bad sites were specifically created to harm this client's reputation, but the registrant is privacy protected. We could at best find out where these sites are hosted. Is there any way we could progress further in finding out more about this? We are talking of a campaing carried out by someone who knows their way around SEO, and which took at least 6 months to a 1 years of constant spammy bombing. Any leads will be greatly appreciated. Regards 5yFVjCI
Intermediate & Advanced SEO | | ClaudioHeilborn0 -
Is it bad practice to create pages that 404?
We have member pages on our site that are initially empty, until the member does some activity. Currently, since all of these pages are soft 404s, we return a 404 for all these pages and all internal links to them are js links (not links as far as bots are concerned). As soon as the page has content, we switch it to 200 and make the links into regular hrefs. After doing some research, I started thinking that this is not the best way to handle this situation. A better idea would be to noindex/follow the pages (before they have content) and let the links to these pages be real links. I'd love to hear input and feedback from fellow Mozzers. What are your thoughts?
Intermediate & Advanced SEO | | YairSpolter0 -
Best way to fix 404 crawl errors caused by Private blog posts in WordPress?
Going over Moz Crawl error report and WMT's Crawl errors for a new client site... I found 44 High Priority Crawl Errors = 404 Not Found I found that those 44 blog pages were set to Private Mode (WordPress theme), causing the 404 issue.
Intermediate & Advanced SEO | | SEOEND
I was reviewing the blog content for those 44 pages to see why those 2010 blog posts, were set to private mode. Well, I noticed that all those 44 blog posts were pretty much copied from other external blog posts. So i'm thinking previous agency placed those pages under private mode, to avoid getting hit for duplicate content issues. All other blog posts posted after 2011 looked like unique content, non scraped. So my question to all is: What is the best way to fix the issue caused by these 44 pages? A. Remove those 44 blog posts that used verbatim scraped content from other external blogs.
B. Update the content on each of those 44 blog posts, then set to Public mode, instead of Private.
C. ? (open to recommendations) I didn't find any external links pointing to any of those 44 blog pages, so I was considering in removing those blog posts. However not sure if that will affect site in anyway. Open to recommendations before making a decision...
Thanks0 -
How do you find synonyms for a word in Google?
Hi, How would you go about finding a connection between words in the eyes of Google? So for example if I enter ~shoes -shoes I get a few things turn up in bold. Boots is one which makes sense and I would assume Google makes a connection between the words so using both in content would help semantically. BUT the other word it bolds is Store - this is where I get lost why would it make this connection unless Google is taking actual query data from users and making a different type of connection between words. How do you find a solid connection between words?
Intermediate & Advanced SEO | | Bondara0 -
404 Error on Blog Pages that Look Like Loading Fine
There was recently a huge increase in 404 errors on Yandex Webmasters corresponding with a drop in rankings. Most of the pages seem to be from my blog (which was updated around the same time). When I click on the links from Yandex the page looks like it is loading normal, expect that it has the following message from the Facebook plugin I am using for commenting Any ideas about what the problem is or how to fix it? Critical Errors That Must Be Fixed | Bad Response Code: | URL returned a bad HTTP response code. | Open Graph Warnings That Should Be Fixed | Inferred Property: | The 'og:url' property should be explicitly provided, even if a value can be inferred from other tags. |
Intermediate & Advanced SEO | | theLotter
| Inferred Property: | The 'og:title' property should be explicitly provided, even if a value can be inferred from other tags. |
| Small og:image: | All the images referenced by og:image should be at least 200px in both dimensions. Please check all the images with tag og:image in the given url and ensure that it meets the recommended specification. |0 -
How the hell do you find good PR websites?
Hi Guys Can someone please help! How do you find high relevant PR sites that can be easiliy located using the SEO MOZ tools? How can I best use the SEO MOZ tools to locate good websites that will help me with linking building? Are the SEO MOZ tools any good?? Please can you help guys..?? Thanks Gareth
Intermediate & Advanced SEO | | GAZ090 -
Original Source and Canonical tags
We've been using canonical links to protect site SEO for contributor content and requiring canonical of our partners (as well as tagging internal duplicate content with canonical). Most other media sites have been doing the same but this is a moving target. I'm now hearing that the original source tag is now a better option. Special focus for us is placement on google news. Any guidance?
Intermediate & Advanced SEO | | jbertfield0 -
Do 404 Errors hurt SEO ?
I recently did a crawl test and it listed over 10,000 pages, but around 282 of them generated 404 errors (bad links) I'm wondering how much this hurts overall SEO and if its something I should focus on fixing asap ? Thanks.
Intermediate & Advanced SEO | | RagingBull0
