Search Pages outranking Product Pages
-
A lot of the results seen in the search engines for our site are pages from our search results on our site, i.e. Widgets | Search Results
This has happened over time and wasn't intentional, but in many cases we see our search results pages appearing over our actual product pages in search, which isn't ideal.
Simply blocking indexing of these pages via robots wouldn't be ideal, at least all at once as we would have that period of time where those Search Results pages would be offline and our product pages would still be at the back of ranking.
Any ideas on a strategy to replace these Search Results with the actual products in a way that won't hurt us too bad during the transition? Or a way to make the actual product pages rank above the search results? Currently, it is often the opposite.
Thanks!
Craig
-
Thanks again for the answers!
Yeah, totally getting you on the Search within search issue. Wish we had known about that a couple of years ago. Did an analytics check and most of our non-home page traffic is coming from Search Results in serps. According to inurl, we have about 200,000 indexed SearchResult pages and based on some data I pulled up, they are our highest traffic non-home page pages, but also the least converting.
I think 301 re-directs on these would be rather tricky. I mean, if someone does a search on our site, they should get the search results page showing them several options, not be shot directly to a single product which might not be the one they need. It would be rather confusing for our regular customers as well.
But I agree we need to do something here, because conversely, our product pages, while getting the least traffic are the highest converters.
My only thought is that we would need to:
1. Find a list of all of the indexed Search Result pages, or at least the ones that have been hit over the last year or so. What would be the best way to do that? Screaming Frog? Analytics?
2. Create a script that analyzes these for the keywords used in them and find a suitable item to re-direct to based on the keyword extracted.
3. 301 re-direct them.
4. Change our current search results urls to include something that would not be included in these original pages so separate them from the old pages that are now being re-directed so that current searchers don't get re-directed as well.
5. Set the search results pages to no - index. Is that the best way to handle that? If we did robots.txt, then we would be breaking the link flow of the site wouldn't we? Don't we need the bots to crawl the search pages to lead to the product pages, or is the sitemap all that is needed?
Thanks for the time and answers!
Craig
-
Hello Craig,
I've dealt with this issue on several client sites and typically opt for noindexing the search pages (sometimes even blocking in Robots.txt) as recommended by others here - especially if you can't make any of them static.
In terms of the product pages, it could be helpful to the visitor if they search for "Specific Product A" for you to just go ahead and land them on the "Specific Product A" page, either via a 301 redirect from the search result page, or by serving up the product page in the first place. This would take care of usability as well as your issue with search engines.
I would not gradually implement something here, as that could be even more confusing to search engines. Do you want the search pages indexed or not?
What I have seen is a temporary blip in traffic (a few weeks at most) followed by improvement in traffic due to an improvement in product page rankings as a result. Every situation is different though, and this assumes good implementation.
Looking at this from Google's perspective, understand that they ARE the search engine so why would they want to send the user to yet another set of search results? Google should know which page on your site to send visitors. They don't need an intermediary, which is why their guidelines say this:
"Use robots.txt to prevent crawling of search results pages or other auto-generated pages that don't add much value for users coming from search engines."
Good luck and let us know how it turns out!
-
Oh, and also, just to clarify.... Are you saying what we should do is 301:
http://oursite.com/SearchResult.html?Text=Monkeys+Ate+Soul
to, let's say
http://oursite.com/ProductPage.html?Title=TheMonkeysAteMySoul
That would be ok?
Thanks!
-
Thanks Jesse. Sounds like a big undertaking, but something we need to move on. Question... How accurate is "site:yoururl.com inurl:search"? I just did a test on it and the number of results that came back is way lower than what it should have been based on how our sitemaps are shown to be indexed in webmastertools.
Thanks for taking the time to answer!
Craig
-
I would be careful about allowing search pages to continually index. You will most likely end up with hundreds if not thousands of low value pages that may cause you to fall into a Panda algo penalty. Simply do a site:yoururl.com inurl:search (or whatever parameter you use ) to see how many pages you have indexed for search results.
You could find the page search pages that are out ranking your product page and 301 them if the traffic is substantial. Otherwise, I would say that by noindexing the search pages, you should reduce the competition for those product pages and they should start to rank and hopefully convert better.
I've had to do the the same for several sites because of a panda penalty so I can't speculate on traffic levels.
-
Thanks Zora! Yeah, these are all going to be dynamic unfortunately, and there are a lot of them. In the hundreds of thousands. So, we would need some type of transition strategy. I would be concerned that a one time no-index all at once would be quite problematic.
Just curious if anyone else had to transition in this way and was able to do so successfully.
Thanks for the feedback!!
Craig
-
We had the same problem, but decided to embrace it.
I started optimizing and adding content to a few of the search results pages (and made them static, not dynamic) and now they rank fairly well.
However, for dynamic search pages I suggest you noindex them.
Google recommends it, and it's best to follow their recommendations.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Wrong page ranking on SERP, above more relevant page
Often I will see the wrong page, something less relevant to a particular search, appear higher on the SERP than a more relevant page. Why does this happen and how can it be remedied? I found this Moz article, has anything been written on this topic more recently. Thanks! https://moz.com/blog/wrong-page-ranking-in-the-results-6-common-causes-5-solutions
On-Page Optimization | | NicheSocial0 -
Any issue with my On page SEO
Kindly review my website and let me know if there is any issue with On page or I am missing anything? Home page - http://www.ayurjeewan.com Deep Page - http://www.ayurjeewan.com/natural/divya-triphala-churna/
On-Page Optimization | | MasonBaker0 -
How would you target alternative names for your product with the use of internal/landing pages?
Recently, there has been some new industry names that have emerged for the type of software we provide and we want to make sure that we rank for those terms (of course!). The 3 names combined are too long for a title tag and would look odd to incl all 3 in the homepage. Any suggestions (or examples) of how this could done without looking spammy? I also don't really know where to put this within our website. e.g. enterprise portal, enterprise information portal (EIP) or corporate portal Any suggestions would be most welcome
On-Page Optimization | | alexpeps0 -
On-page SEO reviews
Hi everyone 🙂 I was hoping someone could point me in a direction on where I could get my website's on-page SEO a review with recommendations. Title tags, meta description, code, H1s, content and so on... I know you can find most of what I'm asking online, but I would like a professional with a new set of eyes to help out. Thanks in advance for your time in helping!
On-Page Optimization | | AutoGlassRescue0 -
How should we handle ecommerce section pages (flagged with duplication) containing the same products?
We've removed a ton of errors, duplication and other stuff since signing up to SEOmoz Pro, but we're getting to the point where what we have left isn't that easy to fix. On one of our (ecommerce) sites we have several sections where people buy products that are applicable to the area of the home. In one or two instances, a particular list of products is the same for two or more different areas - for instance the "Bedroom and Landings" and "Hallway and Stairs" sections may list the same 10 products. This is obviously flagging up as duplication in our reports. What is the best way to handle this situation? Make the one with the highest authority canonical? Point both to another canonical page? Or, try and convince the product department that we should have a more generically name section that both link to? Thanks for any advice!
On-Page Optimization | | Safelincs0 -
Exstinguishing Page Rank?
Hi Guys, Here is a thought. Google gives more weight to links in content, less to navigation etc.. Therefore if they say give 50% of a pages rank to a link within content and 50% to the the other elements. What happens to the total pagerank from a page if you have not utilized in page content links? (is it lost) If this is the case, and you have a site that does not use content links on every page, are you loosing value (and hard earned) pagerank. Google did mention sometime back about pagerank being exstinguished with the nofollow tag. I would be interested to hear what others think? Cheers Scott
On-Page Optimization | | Jurnii0 -
Getting page cached
I am reworking some content that is deep in my site. What is the best way for google to find it? Some of the pages were cached about 3 weeks ago, but I don't want to wait too long to get them to see the new content (and links).
On-Page Optimization | | azguy0 -
Avoiding "Duplicate Page Title" and "Duplicate Page Content" - Best Practices?
We have a website with a searchable database of recipes. You can search the database using an online form with dropdown options for: Course (starter, main, salad, etc)
On-Page Optimization | | smaavie
Cooking Method (fry, bake, boil, steam, etc)
Preparation Time (Under 30 min, 30min to 1 hour, Over 1 hour) Here are some examples of how URLs may look when searching for a recipe: find-a-recipe.php?course=starter
find-a-recipe.php?course=main&preperation-time=30min+to+1+hour
find-a-recipe.php?cooking-method=fry&preperation-time=over+1+hour There is also pagination of search results, so the URL could also have the variable "start", e.g. find-a-recipe.php?course=salad&start=30 There can be any combination of these variables, meaning there are hundreds of possible search results URL variations. This all works well on the site, however it gives multiple "Duplicate Page Title" and "Duplicate Page Content" errors when crawled by SEOmoz. I've seached online and found several possible solutions for this, such as: Setting canonical tag Adding these URL variables to Google Webmasters to tell Google to ignore them Change the Title tag in the head dynamically based on what URL variables are present However I am not sure which of these would be best. As far as I can tell the canonical tag should be used when you have the same page available at two seperate URLs, but this isn't the case here as the search results are always different. Adding these URL variables to Google webmasters won't fix the problem in other search engines, and will presumably continue to get these errors in our SEOmoz crawl reports. Changing the title tag each time can lead to very long title tags, and it doesn't address the problem of duplicate page content. I had hoped there would be a standard solution for problems like this, as I imagine others will have come across this before, but I cannot find the ideal solution. Any help would be much appreciated. Kind Regards5