Soft 404
-
Hey forum,
My site is a Price Comparison site. Lately I've been getting some "Soft 404" errors with the Webmaster tool. I'll try to explain the steps causing it:
1. There's a valid link to a product
2. At some point the product is temporary out of stock or unavailable.
3. Google crawls this product page, getting a valid page with a message explaining this product is unavailable at this time.
4. Google see this page for few different products and (I assume) figures it's a none existing page and so it's a soft 404.
The possible solutions I see are:
1. Return real 404, I'm not a fan of this solution, because these links will very likely be valid again when the product is back in stock.
2. Live with some "soft 404" errors in the webmaster tool.
3. Find another way to explain to Google that it's not a real 404. This sounds great but I'm not sure how this can be done.
Any thoughts which would be the best method? Or maybe another solution I haven't thought of?
Thank you.
-
You're welcome. I hope it all works out as you expect.
-
Without getting too technical, currently the user isn't really being redirected at all, because it's a dynamic page with the results, which can be any number, in this case, 0.
I will take your advice and indeed create a custom "out of stock" page that will be returned for all these cases. Maybe it will be clearer to Google. Obviously these won't rank well, but I'm fine with it, as long as I don't get ranking penalty for the entire site, for none existing pages. Under the circumstances I guess this is the best option.
Thank you very Daniel, you've been very helpful.
-
This is where it goes a bit over my head as a programer, which I'm not, but we would need to dive into the code a bit. I'm not sure I can be of help with details, but from what I'm understanding is as follows.
I understand that if a product is in stock, it shows the page, if the product is not in stock, rather than that pages information changing to say it is no longer in stock, you get redirected to or the page changes to a new page that simply says it can't find what you are looking for.
If I'm right, you need to change the code so when a product is not found or no longer in stock, instead of pointing to this dead page returning zero, or instead of just having that page deleted (in turn being 404), have the page change content or redirect to another page saying it is no longer in stock.
I'm not sure I'm clear here, but what I'm saying is, have it direct to a page you created yourself that says you are temporarily out of stock, rather than the program automatically generating a 404 page.
I hope this helps send you in the right direction, otherwise I'm no programer so can't give you exact instructions, but maybe someone who knows e-commerce programming can help here.
-
Thanks again Daniel.
I'm a web developer too
What would a "proper page" be though? Keep in mind at this point I don't know anything about this product. Each general "out of stock" page will be the same for each product making it a "soft 404" probably, unless I make it a real 404, which will solve the "soft 404" but will create a new problem, 404 pages for some previously valid URLs.
Both are not good, I'm aware of it, however, we are talking less than 0.05% of the site's pages.
-
OK, from what I can see in your example link and what you just confirmed in your last note, the problem is in the design of the database search.
If a product is out of stock, instead of just saying that particular product is out of stock, it comes back with a 0 search results returned. It's basically searching for something and takes you to a page saying that doesn't exist. That would totally explain why you are getting soft 404 errors because you are basically searching for a page that doesn't exist.
You need your web developer to fix this so it takes you to a proper page with some sort of information rather than what is currently a nice looking soft 404 page.
-
Thanks for the reply Daniel. Here's an example link: link
Basically anything with a wrong number will return this page. I know it's not a great page for this purpose, just a regular product page with 0 items and a message. It's just rare enough that we didn't spend too much on it. How rare? According to the Webmaster tool, out of the last 296k pages crawled, 70 were found.
Basically at this point, I have no information on this item, all I know is that someone got here so it's probably a valid product code, which is true unless someone just edited the URL manually.
-
I'm not an expert in this area, but it sounds like a coding issue. Somehow when Google looks at the page it triggers that error. If I understand correctly, when you are out of stock, the system automatically generates a message that says it is out of stock. What does that page look like? Maybe if you post an example of that webpage it could be helpful.
I'm thinking you will need to modify that out of stock template so it includes other information. Whether it be as Kaushal recommended, or even just plain text saying anything. Maybe "Sorry we are currently out of stock, please check back later or contact us for an ETA". Having other information on the page should show to Google it is still an active page with content on it. One way or another, the problem sounds like it's with that out of stock template the database is using.
Maybe I'm way off, but if you link to an example page, that would probably help.
-
Thanks for the reply Kaushal. We actually don't have a system currently that lists similar products and considering we have over 20 million products, it's also not a minor thing to implement. Anyway I'm not sure I like the way other sites try to push products that aren't really what you were looking for.
-
Can't you show message "Product is out of stock for now" message. And show related product below with "You might be interested in below product" message.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
301 or 404 Question for thin content Location Pages we want to remove
Hello All, I have a Hire Website with many categories and individual location pages for each of the 70 depots we operate. However, being dynamic pages, we have thousands of thin content pages. We have decided to only concentrate on our best performing locations and get rid of the rest as its physically impossible to write unique content for all our location pages for every categories. Therefore my question is. Would it cause me problems by having to many 301's for the location pages I am going to re-direct ( i was only going to send these back to the parent category page) or should I just 404 all those location pages and at some point in the future when we are in a position to concentrate on these locations then redo them with new content ? in terms of url numbers It would affect a few thousand 301's or 404's depending on people thoughts. Also , does anyone know what percentage of thin content on a site should be acceptable ?.. I know , none is best in an ideal world but it would be easier if there we could get away with a little percentage. We have been affected by Panda , so we are trying to tidy things up as best at possible, Any advice greatly appreciated? thanks Peter
Intermediate & Advanced SEO | | PeteC120 -
Images Returning 404 Error Codes. 301 Redirects?
We're working with a site that has gone through a lot of changes over the years - ownership, complete site redesigns, different platforms, etc. - and we are finding that there are both a lot of pages and individual images that are returning 404 error codes in the Moz crawls. We're doing 301 redirects for the pages, but what would the best course of action be for the images? The images obviously don't exist on the site anymore and are therefore returning the 404 error codes. Should we do a 301 redirect to another similar image that is on the site now or redirect the images to an actual page? Or is there another solution that I'm not considering (besides doing nothing)? We'll go through the site to make sure that there aren't any pages within the site that are still linking to those images, which is probably where the 404 errors are coming from. Based on feedback below it sounds like once we do that, leaving them alone is a good option.
Intermediate & Advanced SEO | | garrettkite0 -
What to do when all products are one of a kind WYSIWYG and url's are continuously changing. Lots of 404's
Hey Guys, I'm working on a website with WYSIWYG one of a kind products and the url's are continuously changing. There are allot of duplicate page titles (56 currently) but that number is always changing too. Let me give you guys a little background on the website. The site sells different types of live coral. So there may be anywhere from 20 - 150 corals of the same species. Each coral is a unique size, color etc. When the coral gets sold the site owner trashes the product creating a new 404. Sometimes the url gets indexed, other times they don't since the corals get sold within hours/days. I was thinking of optimizing each product with a keyword and re-using the url by having the client update the picture and price but that still leaves allot more products than keywords. Here is an example of the corals with the same title http://austinaquafarms.com/product-category/acans/ Thanks for the help guys. I'm not really sure what to do.
Intermediate & Advanced SEO | | aronwp0 -
404 for duplicate content?
Sorry, I think this is my third question today... But I have a lot of duplicated content on my site. I use joomla so theres a lot of unintentional duplication. For example, www.mysite.com/index.php exists, etc. Up till now, I thought I had to 301 redirect or rel=canonical these "duplicated pages." However, can I just 404 it? Is there anything wrong with this rpactice in regards to SEO?
Intermediate & Advanced SEO | | waltergah0 -
Soft 404's from pages blocked by robots.txt -- cause for concern?
We're seeing soft 404 errors appear in our google webmaster tools section on pages that are blocked by robots.txt (our search result pages). Should we be concerned? Is there anything we can do about this?
Intermediate & Advanced SEO | | nicole.healthline4 -
Status Code: 404 Errors. How to fix them.
Hi, I have a question about the "4xx Staus Code" errors appearing in the Analysis Tool provided by SEOmoz. They are indicated as the worst errors for your site and must be fixed. I get this message from the good people at SEOmoz: "4xx status codes are shown when the client requests a page that cannot be accessed. This is usually the result of a bad or broken link." Ok, my question is the following. How do I fix them? Those pages are shown as "404" pages on my site...isn't that enough? How can fix the "4xx status code" errors indicated by SEOmoz? Thank you very much for your help. Sal
Intermediate & Advanced SEO | | salvyy0 -
Soft 404 problem
I have a soft 404 problem in webmaster tools for http://www.musicliveuk.com/about/feed and I'm not sure why. I read on here that if it is a main content page it should be fixed but I don't know how. I've tried to 301 redirect the page to http://www.musicliveuk.com/about/ but the redirect doesn't appear to be working? how do I fix this?
Intermediate & Advanced SEO | | SamCUK0 -
404 Redirecting to the home page
One of my clients that is managing their own server and website recently moved servers. Which then broke their custom 404 page. Instead of fixing this or putting the site back to the old server they redirected the 404 to the home page. I've been working on getting their 404's appropriately redirected, or old urls redirection using a 301 for a month or two. I read the HTTP Status Codes best practices. It just discusses usability. What technical seo back lash can happen?
Intermediate & Advanced SEO | | triveraseo0