Soft 404
-
Hey forum,
My site is a Price Comparison site. Lately I've been getting some "Soft 404" errors with the Webmaster tool. I'll try to explain the steps causing it:
1. There's a valid link to a product
2. At some point the product is temporary out of stock or unavailable.
3. Google crawls this product page, getting a valid page with a message explaining this product is unavailable at this time.
4. Google see this page for few different products and (I assume) figures it's a none existing page and so it's a soft 404.
The possible solutions I see are:
1. Return real 404, I'm not a fan of this solution, because these links will very likely be valid again when the product is back in stock.
2. Live with some "soft 404" errors in the webmaster tool.
3. Find another way to explain to Google that it's not a real 404. This sounds great but I'm not sure how this can be done.
Any thoughts which would be the best method? Or maybe another solution I haven't thought of?
Thank you.
-
You're welcome. I hope it all works out as you expect.
-
Without getting too technical, currently the user isn't really being redirected at all, because it's a dynamic page with the results, which can be any number, in this case, 0.
I will take your advice and indeed create a custom "out of stock" page that will be returned for all these cases. Maybe it will be clearer to Google. Obviously these won't rank well, but I'm fine with it, as long as I don't get ranking penalty for the entire site, for none existing pages. Under the circumstances I guess this is the best option.
Thank you very Daniel, you've been very helpful.
-
This is where it goes a bit over my head as a programer, which I'm not, but we would need to dive into the code a bit. I'm not sure I can be of help with details, but from what I'm understanding is as follows.
I understand that if a product is in stock, it shows the page, if the product is not in stock, rather than that pages information changing to say it is no longer in stock, you get redirected to or the page changes to a new page that simply says it can't find what you are looking for.
If I'm right, you need to change the code so when a product is not found or no longer in stock, instead of pointing to this dead page returning zero, or instead of just having that page deleted (in turn being 404), have the page change content or redirect to another page saying it is no longer in stock.
I'm not sure I'm clear here, but what I'm saying is, have it direct to a page you created yourself that says you are temporarily out of stock, rather than the program automatically generating a 404 page.
I hope this helps send you in the right direction, otherwise I'm no programer so can't give you exact instructions, but maybe someone who knows e-commerce programming can help here.
-
Thanks again Daniel.
I'm a web developer too
What would a "proper page" be though? Keep in mind at this point I don't know anything about this product. Each general "out of stock" page will be the same for each product making it a "soft 404" probably, unless I make it a real 404, which will solve the "soft 404" but will create a new problem, 404 pages for some previously valid URLs.
Both are not good, I'm aware of it, however, we are talking less than 0.05% of the site's pages.
-
OK, from what I can see in your example link and what you just confirmed in your last note, the problem is in the design of the database search.
If a product is out of stock, instead of just saying that particular product is out of stock, it comes back with a 0 search results returned. It's basically searching for something and takes you to a page saying that doesn't exist. That would totally explain why you are getting soft 404 errors because you are basically searching for a page that doesn't exist.
You need your web developer to fix this so it takes you to a proper page with some sort of information rather than what is currently a nice looking soft 404 page.
-
Thanks for the reply Daniel. Here's an example link: link
Basically anything with a wrong number will return this page. I know it's not a great page for this purpose, just a regular product page with 0 items and a message. It's just rare enough that we didn't spend too much on it. How rare? According to the Webmaster tool, out of the last 296k pages crawled, 70 were found.
Basically at this point, I have no information on this item, all I know is that someone got here so it's probably a valid product code, which is true unless someone just edited the URL manually.
-
I'm not an expert in this area, but it sounds like a coding issue. Somehow when Google looks at the page it triggers that error. If I understand correctly, when you are out of stock, the system automatically generates a message that says it is out of stock. What does that page look like? Maybe if you post an example of that webpage it could be helpful.
I'm thinking you will need to modify that out of stock template so it includes other information. Whether it be as Kaushal recommended, or even just plain text saying anything. Maybe "Sorry we are currently out of stock, please check back later or contact us for an ETA". Having other information on the page should show to Google it is still an active page with content on it. One way or another, the problem sounds like it's with that out of stock template the database is using.
Maybe I'm way off, but if you link to an example page, that would probably help.
-
Thanks for the reply Kaushal. We actually don't have a system currently that lists similar products and considering we have over 20 million products, it's also not a minor thing to implement. Anyway I'm not sure I like the way other sites try to push products that aren't really what you were looking for.
-
Can't you show message "Product is out of stock for now" message. And show related product below with "You might be interested in below product" message.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
404 broken URLs coming up in Google
When we do a search for our brand, we are get the following results in google.com.au (see image attachment). As outlined in red, there are listings in Google that result in 404 Page Not Found URLs. What can we do to enable google to do a recrawl or to ensure that these broken URLs are no longer listed in Google? Thanks for your help here! sBqpvtj
Intermediate & Advanced SEO | | Gavo0 -
How to find all 404 deadlinks - webmaster only allows 1000 to be downloaded...
Hi Guys I have a question...I am currently working on a website that was hit by a spam attack. The website was hacked and 1000's of adult censored pages were created on the wordpress site. The hosting company cleared all of the dubious files - but this has left 1000's of dead 404 pages. We want to fix the dead pages but Google webmaster only shows and allows you to download 1000. There are a lot more than 1000....does any know of any Good tools that allows you to identify all 404 pages? Thanks, Duncan
Intermediate & Advanced SEO | | CayenneRed890 -
Can't diagnose this 404 error
Hi Moz community I have started receiving a load of 404 errors that look like this: This page: http://paulminors.com/blog/page/5/ is linking to: http://paulminors.com/category/podcast/paulminors.com which is a broken link. This is happening with a load of other pages as well. It seems that "paulminors.com" is being added to the end of the linking pages URL.I'm using Wordpress and the SEO by Yoast plugin. I have searched for this link in the source of the linking page but can't find it, so I'm struggling to diagnose the problem. Does anyone have any ideas on what could be causing this? Thanks in advance Paul
Intermediate & Advanced SEO | | kevinliao0 -
Do 410 show in the 404 not found section in Google Webmaster Tools?
Question: Do 410 show in the 404 not found section in Google Webmaster Tools? Specific situation: We got rid of an entire subdomain except for a few pages that we 301'd to relevant content on our main domain. The rest return a 404 not found. These show up in our google webmaster tools as crawl errors. I was wondering since 410 is a content gone error and we intentionally want this content gone, if we switch it to 410, does Google still report it as a 404 error? Thanks
Intermediate & Advanced SEO | | MarloSchneider0 -
Empty search results labeled as Soft 404s?
I have a site with faceted search but sometimes when someone drills down too far it ends up with no results. The page and outlined and faceted navigation are still there. The site uses dynamic URLs for the faceted navigation but Google is reporting these no results pages as Soft 404s. How should we handle these? Should we redirect these? Can we return 404 in the status code but still show the no results page they are looking for? Thanks for your responses
Intermediate & Advanced SEO | | MarloSchneider0 -
How to get around Google Removal tool not removing redirected and 404 pages? Or if you don't know the anchor text?
Hello! I can’t get squat for an answer in GWT forums. Should have brought this problem here first… The Google Removal Tool doesn't work when the original page you're trying to get recached redirects to another site. Google still reads the site as being okay, so there is no way for me to get the cache reset since I don't what text was previously on the page. For example: This: | http://0creditbalancetransfer.com/article375451_influencial_search_results_for_.htm | Redirects to this: http://abacusmortgageloans.com/GuaranteedPersonaLoanCKBK.htm?hop=duc01996 I don't even know what was on the first page. And when it redirects, I have no way of telling Google to recache the page. It's almost as if the site got deindexed, and they put in a redirect. Then there is crap like this: http://aniga.x90x.net/index.php?q=Recuperacion+Discos+Fujitsu+www.articulo.org/articulo/182/recuperacion_de_disco_duro_recuperar_datos_discos_duros_ii.html No links to my site are on there, yet Google's indexed links say that the page is linking to me. It isn't, but because I don't know HOW the page changed text-wise, I can't get the page recached. The tool also doesn't work when a page 404s. Google still reads the page as being active, but it isn't. What are my options? I literally have hundreds of such URLs. Thanks!
Intermediate & Advanced SEO | | SeanGodier0 -
Robots.txt 404 problem
I've just set up a wordpress site with a hosting company who only allow you to install your wordpress site in http://www.myurl.com/folder as opposed to the root folder. I now have the problem that the robots.txt file only works in http://www.myurl./com/folder/robots.txt Of course google is looking for it at http://www.myurl.com/robots.txt and returning a 404 error. How can I get around this? Is there a way to tell google in webmaster tools to use a different path to locate it? I'm stumped?
Intermediate & Advanced SEO | | SamCUK0 -
New web site - 404 and 301
Hello, I have spent a lot of times on the forum trying to make sure how to deal with my client situation. I will tell you my understanding of the strategy to apply and I would appreciate if you could tell me if the strategy will be okay. CONTEXT I am working on a project where our client wants to replace its current web site with a new one. The current web site has at least 100 000 pages. The new web site will replace all the existing pages of the current site. What I have heard for the strategy the client wants to adopt is to 404 each pages and to 301 redirect each page. Every page would be redirect to a page that make sense in the new web site. But after reading other answers and reading the following comment, I am starting to be concerned: '(4) Be careful with a massive number of 301s. I would not 301 100s of pages at once. There's some evidence Google may view this as aggressive PR sculpting and devalue those 301s. In that case, I'd 301 selectively (based on page authority and back-links) and 404 the rest.' I have also read about performance issue ... QUESTION So, if we suppose that we can manage to map each of the old site pages to a page in the new web site, is a problem to do it? Do you see a performance issue or devaluation potential issue? If it is a problem, please comment the strategy I might considere to suggest: Identify the pages for which I gain links From that group, identify the pages, that gives me most of my juice 301 redirect them and for the other, create a real great 404 ... Thanks ! Nancy
Intermediate & Advanced SEO | | EnigmaSolution0