404 issues
-
Hello,
Some time ago, something like a month and a half) I have removed all 404 errors from the google index and the webmaster tools have removed them already, however yesterday moz found the same 404 errors that i have removed from indexing (tose pages are deleted or redirected by the site developer).
What could be an issue here and why webmaster tools are not registering those 404 errors but moz analytics does.
And the other question is if those pages do not exist can i track where the placed? I tried dowloading moz crawl test, but the refering source was not provided.
I would highly appreciate anyones help.
Thank you
-
Hello!
I took a look at your sites and we last crawled them in July so we haven't discovered any new links to follow to your site to update our index. We will only store indexed data for up to 80 days unless re-crawled. Using Raven Tools and others is a better way to look at your full profile while OSE looks for fresh, diverse, and important links.
Hope this helps!
-
Rikomuttik-
If you do, indeed, have inbound links from other sites pointing over to your site, this is a really good thing. This often happens when people want to link to an article, image or other page within the site.
I'd do a crawl on Open Site Explorer, or within Google's Webmaster Tools, and see if you can find any inbound links that are pointing to non-existing pages, and your system is giving 404 errors.
Then, I'd use a 301 redirect to take the inbound link and direct it to the proper location. Or, if you really want, you can re-create the page at the older location, but just make sure that you're not creating duplicate content on the site.
Hope this helps!
- Jeff
-
Hey Jeff,
Thank you for your answers.
I assume the issue might be within the point 3 from your suggestion list, is there something i could do find automatically this or perhaps just to go through all of the backlinks and somehow to find it old links like this?
Or there is nothing I can really do about it and just to ignore? Will it not hurst the website?
Thank you!
-
Rikomuttik-
There are a couple of reasons why 404 errors might be showing up again, even if you've fixed them in Google.
1. Moz might be using an older crawl that still lists pages that don't exist on the site.
2. If you're using a soft 404 error handling (i.e. all 404 errors redirect to the home page), then Google might not see the errors, but perhaps Moz does?
3. It's possible that you have inbound links from other sites that point to your site, that is throwing 404 errors, and that's what it being seen by other search engines.
4. It's also possible that the 301 redirects you might have set up in your .htaccess file have been changed, or are no longer working?
5. It's also possible that an older page that used to be on the site, was removed, was added back in, and that page has links that go to 404 pages?
Hope this helps?
-- Jeff
-
I really think that Moz lacks in this area. For finding things like this I use Raven Tools, they have a really good crawler. It clearly shows all of the pages that reference an error. My thoughts would be that either you missed some links to the pages or the redirects are not working properly, I would suspect that if Moz finds them, Google or Bing will find them.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Google search console showing canonical issues
I have a problem , canonical tags present in my web pages, but still google search console showing canonical issue for example check this page https://kilid.com
Technical SEO | | ParastooDezyani0 -
404 crawl errors ending with your domain name??
Hello, I have a crawl test with numerous 404 errors ending with my domain name..? Not sure what the cause is. Plugins? Ecommerce? I use Wordpress if that could lead to an answer. Thanks for your time. K
Technical SEO | | Hydraulicgirl0 -
Issue with Cached pages
I have a client who has a three domains:
Technical SEO | | paulbaguley
budgetkits.co.uk
prosocceruk.co.uk
cheapfootballkits.co.uk Budget Kits is not active but Pro Soccer and Cheap Football Kits are. The issue is when you do site:budgetkits.co.uk on Google it brings back results. If you click on the link it goes to page saying website doesn't exist which is correct but if you click on cached it shows you a page from prosocceruk.co.uk or cheapfootballkits.co.uk. The cached pages are very recent by a couple of days ago to a week. The first result brings up www.budgetkits.co.uk/rainwear but the cached page is www.prosocceruk.co.uk/rainwear The third result brings up www.budgetkits.co.uk/kids-football-kits but the cached page is http://www.cheapfootballkits.co.uk The history of this issue is that budgetkits.co.uk was its own website 7 years ago and then it used to point at prosocceruk.co.uk after that but it no longer does for about two months. All files have been deleted from budgetkits.co.uk so it is just a domain. Any help with this would be very much appreciated as I have not seen this kind of issue before.0 -
Pagination Issue
Hello Community, We have a pagination issue on a set of pages : http://homengo.com/s/location/ http://homengo.com/s/location/?page=1 and so on ( ?page=2, ?page=3, ...). As you can see in the source code the pagination rel and prev are there. First question : does moz crawler know and recognize pagination ? Second question : if yes then do you know what could be wrong with pagination on these pages ? Thanks
Technical SEO | | seomengo0 -
Backlinks that we have if they are 404?
Hi All, Backlinks that we have if they are 404? Open site explorer shows 1,000 of links and when I check many are 404 and those are spammy links which we had but now the sites are 404 I am doing a link profile check which is cleaning up all spammy links Should i take any action on them? As open site explorer or Google still shows these links on the searches. Should we mention these URL's in disallow in Google webmaster. Thanks
Technical SEO | | mtthompsons0 -
MSNbot Issues
We found msnbot is doing lots of request at same time to one URL, even considering we have caching, it triggers many requests at same time so caching does not help at the moment: For sure we can use mutex to make sure URL waits for cache to generate, but we are looking for solution for MSN boot. 123.253.27.53 [11/Dec/2012:14:15:10 -0600] "GET //Fun-Stuff HTTP/1.1" 200 0 "-" "msnbot/2.0b (+http://search.msn.com/msnbot.htm)" 1.253.27.53 [11/Dec/2012:14:15:10 -0600] "GET //Type-of-Resource/Fun-Stuff HTTP/1.1" 200 0 "-" "msnbot/2.0b (+http://search.msn.com/msnbot.htm)" 1.253.27.53 [11/Dec/2012:14:15:10 -0600] "GET /Browse//Fun-Stuff HTTP/1.1" 200 6708 "-" "msnbot/2.0b (+http://search.msn.com/msnbot.htm)" We found the following solution: http://www.bing.com/community/site_blogs/b/webmaster/archive/2009/08/10/crawl-delay-and-the-bing-crawler-msnbot.aspx Bing offers webmasters the ability to slow down the crawl rate to accommodate web server load issues. User-Agent: * Crawl-Delay: 10 Need to know if it’s safe to apply that. OR any other advices. PS: MSNBot gets so bad at times that it could trigger a DOS attack – alone! (http://www.semwisdom.com/blog/msnbot-stupid-plain-evil#axzz2EqmJM3er).
Technical SEO | | tpt.com0 -
Duplicate Title Tag issue due to Shopify CMS
Hi guys, I'm a novice really when it comes to SEO, yet have taken it in house for the next year or so, firstly because I have had my fingers burnt twice...and secondly, to allow me to recoup some of the loss from my prior campaigns. One thing I have noticed on my site (which uses a Shopify E-commerce CMS), is that Shopify duplicates a url for each my products. An example of this is http://www.vidahomes.co.uk/collections/designer-radiators-heating/products/reina-aliano
Technical SEO | | philscott2006
http://www.vidahomes.co.uk/products/reina-aliano Both products provide exactly the same information, yet appear in different ways subject to how the customer finds them. I contacted Shopify to find a fix to this issue when I noticed a high amount of Duplicate Title Tags in my SEO crawl. Their response was as follows. Using a rel canonical link will help prevent duplicate content issues with search engines. All you need to do is add this line of code: **<link rel="canonical" href="{{ canonical_url }}" />** ** before the tag in the theme.liquid file. It’s that simple :)** The theme liquid file basically generates the outer template for the whole site, and is only compromised when over-ruled. This all seems a little too easy for me, so I am hoping whether someone can elaborate as to whether this will work or not, as I'm not entirely sold on their response. I was always under the impression with canonical tags, that they should be added to the header section of the duplicate page in question, which refers back to the original page. The code I have been told to add above implies that the canonical tag would be added to every page in my site so the Google robot would have a hard time in finding anything at all of relevance Thanks in advance for any assistance with this. Kind Regards Phil Scott Vida Homes0 -
How to solve issues regarding canonicalization?
Today, I was searching for article which may help me in issues regarding canonicalization and found very interesting article on SEOmoz. I am facing issues regarding de-indexing of pages and down of organic search engine visits. I have done proper R & D and apply it very carefully. But, still my indexed pages and visits are going down. I have applied canonical tag to following pages. Narrow by search: http://www.vistastores.com/outdoor-umbrellas?manufacturer=California+Umbrella Sorting: http://www.vistastores.com/outdoor-umbrellas?dir=desc&order=position Pagination: http://www.vistastores.com/outdoor-umbrellas?p=2 How can I improve my performance?
Technical SEO | | CommercePundit0