Indexing of Search Pages
-
I have a question on indexing search pages of an ecommerce or any website. I read Google doesn't recommend this and sites shouldn't allow indexing of their search pages.
I recently attended an SEO event (BrightonSEO) and one of the talks was on search pages and how big players like eBay, Amazon do index their search pages. In fact, it is a core part of the pages that are indexed.
eBay has to do it, as their product pages are on a time frame and Amazon only allows certain category search pages to be indexed. Reviewing my competitors, they are indexing search pages and this is why they have thousands and millions of web pages indexed.
What are your thoughts? I thought search pages were too dynamic (URL strings) and they wouldn't have a unique page title, meta description or rich content to act as a well optimised page.
Am I missing a trick here?
Cyto
-
Hmm, so what it comes down to is that, you can index search pages but provided they have a purpose or add value to the end user.
For instance, A user would search by category whereas an individual product search result isn't necessary when a product page exists.
Thanks Dirk for the links, helps a lot
Cyto
-
Fantastic as always, Dirk!
-
Hi,
If you read this article (https://www.mattcutts.com/blog/search-results-in-search-results/) - the official guideline is "Use robots.txt to prevent crawling of search results pages or other auto-generated pages **that don’t add much value for users coming from search engines". **(added the bold)
The question is: what is a search result page. if you're selling LCD tv's - the page which is showing only Panasonic tv's could be considered a search result from a query on the site, but it could also be considered as a page which offers value for users searching for a Panasonic LCD tv. Idem if you look for 'jobs in Montreal' - one of the first results is http://ca.indeed.com/jobs-in-Montréal,-QC - which is the same result that you would get if you would search Montreal on http://ca.indeed.com/
If these sites didn't index these "search results pages" they would almost never show up in the SERP's. I think the important part is "adding value for the users".
On dynamic search pages (or facetted navigation) Google even made best practices (http://googlewebmastercentral.blogspot.nl/2014/02/faceted-navigation-best-and-5-of-worst.html) - even though you could consider all these kind of pages as search results.
Hope this clarifies,
Dirk
-
I can see the issue with auctionbased e-commerce sites. But a search result page could be both dynamic and static:
domain.com/results/name-of-search-string
or
domain.com/results/?q=something
I think that optimizing a search result page would be rather difficult since it depends on a unique search which is inpredictable. However, using a static URL for a result page is no good either, as it creates a ton of pages in an index with no meaning.
I wouldn't think that any common site should index their search result pages.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Rel canonical on other page instead of duplicate page. How Google responds?
Hi all, We have 3 pages for same topics. We decided to use rel canonical and remove old pages from search to avoid duplicate content. Out of these 3 pages....1 and 2 type of pages have more similar content where 3 type don't have. Generally we must use rel canonical between 1 and 2. But I am wondering what happens if I canonical between 1 and 3 while 2 has more similar content? Will Google respects it or penalise as we left the most similar page and used other page for canonical. Thanks
Algorithm Updates | | vtmoz0 -
If we have all products on-site for indexing, do we get dinged by Google for not transacting on-site?
I am trying to do research on the SEO impact of having an off-site transactional website. For example, Pepsi.com lists all product information on their site but guides visitors to transact on Amazon or Walmart. What impact, if any, does guiding the customer to a separate transactional site have on SEO? In short, if we have all products on-site for indexing, do we get dinged by Google for not transacting on-site?
Algorithm Updates | | KaylaV0 -
Software to indicate search volumes/trends
Is there any software that exists to help provide an indication of the search volumes or trends behind keywords? Currently we use google trends for a YOY and WOW view for some select KW's but the reality is are search volumes are effected by 1,000's of KW's and trying to get an accurate view of overall trends and theme with our product sector is difficult. I'm interested to find out if there is software which is an alternative to google trends or if there is 3rd party software available that lets us process google trends data in bulk?
Algorithm Updates | | SEO-SMB0 -
How come google image search doesn't link to the right page?
For one site I work with the images link to the home page of the site rather than the page the image lives on. I think this is hurting my bounce rate quite a bit. Thoughts?
Algorithm Updates | | NetvantageMarketing0 -
Organic listing & map listing on 1st page of Google
Hi, Back then, a company could get multiple listings in SERP, one in Google Maps area and a homepage or internal pages from organic search results. But lately, I've noticed that Google are now putting together the maps & organic listings. This observation has been confirmed by a couple of SEO people and I thought it made sense, but one day I stumble with this KWP "bmw dealership phoenix" and saw that www.bmwnorthscottsdale.com has separate listing for google places and organic results. Any idea how this company did this? Please see the attached image
Algorithm Updates | | ao5000000 -
How to search for popular press releases
I would like to research popular press releases in my industry. Ones that got picked up by many popular outlets, got a lot of coverage etc. Besides mindlessly searching the web for press releases, is there a better way? Almost looking for a service that ranks press releases in terms of effectiveness.
Algorithm Updates | | StreetwiseReports0 -
Google Dropped 3,000+ Pages due to 301 Moved !! Freaking Out !!
We may be the only people stupid enough to accidentally prevent the google bot from indexing our site. In our htaccess file someone recently wrote the following statement RewriteEngine On
Algorithm Updates | | David_C
RewriteCond %{HTTP_HOST} ^mysite.com$ [NC]
RewriteRule ^(.*)$ http://www.mysite.com/$1 [L,R=301] Its almost funny because it was a rewrite that rewrites back to itself... We found in webmaster tools that the site was not able to be indexed by the google bot due to not detecting the robots.txt file. We didn't have one before as we didn't really have much that needed to be excluded. However we have added one now for kicks really. The robots.txt file though was never the problem with regard to the bot accessing the site. Rather it was the rewrite statement above that was blocking it. We tested the site not knowing what the deal was so we went under webmaster tools then health and then selected "Fetch as Google" to have the website. This was our way of manually requesting the site be re-indexed so we could see what was happening. After doing so we clicked on status and it provided the following: HTTP/1.1 301 Moved Permanently
Content-Length: 250
Content-Type: text/html
Location: http://www.mystie.com/
Server: Microsoft-IIS/7.5
MicrosoftOfficeWebServer: 5.0_Pub
MS-Author-Via: MS-FP/4.0
X-Powered-By: ASP.NET
Date: Wed, 22 Aug 2012 02:27:49 GMT
Connection: close <title>301 Moved Permanently</title> Moved Permanently The document has moved here. We changed the screwed up rewrite mistake in the htaccess file that found its way in there but now our issue is that all of our pages have been severely penalized with regard to where they are now ranking compared to just before the indecent. We are essentially freaking out because we don't know the real time consequences of this and if or how long it will take for the certain pages to regain their prior ranks. Typical pages when down anywhere between 9-40 positions on high volume search terms. So to say the least our company is already discussing the possibilities of fairly large layoffs based on what we anticipate with regard to the drop in traffic. This sucks because this is peoples lives but then again a business must make money and if you sell less you have to cut the overhead and the easiest one is payroll. I'm on a team with three other people that I work with to keep the SEO side up to snuff as much as we can and we sell high ticket items so the potential effects if Google doesn't restore matters could be significant. My question is what would you guys do? Is there any way we can contact Google about such a matter? If you can I've never seen such a thing. I'm sure the pages that are missing from the index now might make their way back in but what will there rank look like next time and with that type of rewrite has it permanently effected every page site wide, including those that are still in the index but severely effected by the index. Would love to see things bounce back quick but I don't know what to expect and neither do my counterparts. Thanks for any speculation, suggestions or insights of any kind!!!0 -
Elaborate Search Results
Please see the attached image. My question : How can I have such results showing for my own website? I mean what should I do to make this happen? 3ZQfr.jpg
Algorithm Updates | | KS__0