Indexing of Search Pages
-
I have a question on indexing search pages of an ecommerce or any website. I read Google doesn't recommend this and sites shouldn't allow indexing of their search pages.
I recently attended an SEO event (BrightonSEO) and one of the talks was on search pages and how big players like eBay, Amazon do index their search pages. In fact, it is a core part of the pages that are indexed.
eBay has to do it, as their product pages are on a time frame and Amazon only allows certain category search pages to be indexed. Reviewing my competitors, they are indexing search pages and this is why they have thousands and millions of web pages indexed.
What are your thoughts? I thought search pages were too dynamic (URL strings) and they wouldn't have a unique page title, meta description or rich content to act as a well optimised page.
Am I missing a trick here?
Cyto
-
Hmm, so what it comes down to is that, you can index search pages but provided they have a purpose or add value to the end user.
For instance, A user would search by category whereas an individual product search result isn't necessary when a product page exists.
Thanks Dirk for the links, helps a lot
Cyto
-
Fantastic as always, Dirk!
-
Hi,
If you read this article (https://www.mattcutts.com/blog/search-results-in-search-results/) - the official guideline is "Use robots.txt to prevent crawling of search results pages or other auto-generated pages **that don’t add much value for users coming from search engines". **(added the bold)
The question is: what is a search result page. if you're selling LCD tv's - the page which is showing only Panasonic tv's could be considered a search result from a query on the site, but it could also be considered as a page which offers value for users searching for a Panasonic LCD tv. Idem if you look for 'jobs in Montreal' - one of the first results is http://ca.indeed.com/jobs-in-Montréal,-QC - which is the same result that you would get if you would search Montreal on http://ca.indeed.com/
If these sites didn't index these "search results pages" they would almost never show up in the SERP's. I think the important part is "adding value for the users".
On dynamic search pages (or facetted navigation) Google even made best practices (http://googlewebmastercentral.blogspot.nl/2014/02/faceted-navigation-best-and-5-of-worst.html) - even though you could consider all these kind of pages as search results.
Hope this clarifies,
Dirk
-
I can see the issue with auctionbased e-commerce sites. But a search result page could be both dynamic and static:
domain.com/results/name-of-search-string
or
domain.com/results/?q=something
I think that optimizing a search result page would be rather difficult since it depends on a unique search which is inpredictable. However, using a static URL for a result page is no good either, as it creates a ton of pages in an index with no meaning.
I wouldn't think that any common site should index their search result pages.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Duplicate pages in language versions, noindex in sitemap and canonical URLs in sitemap?
Hi SEO experts! We are currently in the midst of reducing our amount of duplicate titles in order to optimize our SEO efforts. A lot of the "duplicate titles" come from having several language versions of our site. Therefore, I am wondering: 1. If we start using "" to make Google (and others) aware of alternative language versions of a given site/URL, how big a problem will "duplicate titles" then be across our domains/site versions? 2. Is it a problem that we in our sitemap include (many) URL's to pages that are marked with noindex? 3. Are there any problems with having a sitemap that includes pages that includes canonical URL's to other pages? Thanks in advance!
Algorithm Updates | | TradingFloor.com0 -
Why isn't our structured markup showing in search results
Hi All, We installed Schema.org structured markup on our pages nearly 1.5 months ago at this point and we have yet to see the markup show in the search results. It also checks out in Webmaster tools and Google's structured markup language testing tool. So, I'm just confused why it's not even showing up site a "site" search in Google either. Here's an example of two such pages on our site: http://www.learningtree.com/htfu/usdc01/washington/java-perl-and-python-programming-training and http://www.learningtree.com/htfu/usat40/alpharetta/it-and-management-training Any advice is greatly appreciated! Thank you 🙂
Algorithm Updates | | CSawatzky0 -
Have I been Hit by a Penguin? No Warning in Webmaster / Some Pages still Rank
Hi all, I have recently signed up to MOZ as I have seen a large drop in the turnover of a site I work with as well as a slump in visitors. I know part of this slump is the transition from google product search from being free to paid and chewing through our adwords budget quicker. The other part though seems a little more tricky, I have always been under the impression from reading online that an algorithm update would see a site destroyed for most terms and a notification generated in webmaster tools, however the site still seems to still rank for some terms, others however it has fallen off the face of the earth for. As you can see in the attachment webmaster tools is showing much decreased visibility, and MOZ agrees with this. Key terms that have lost rank have done so by around 4-10 positions. The content on the site has all been hand written by myself, however some of the pages are a little "stale" so I am currently running through re-writing every product page on the site (1000 products or so) all my product pages grade a minimum B with 99% A on the Moz page grader. I am keeping my fingers crossed that fresh content should assist in getting google interested again? However my real questions is, Is this Penguin? or is this just stale content? dmDdMr5.jpg pYkzck0.jpg 9f4mgM9.jpg
Algorithm Updates | | speedingorange1 -
Rankings fluctuating by around 10 pages between night and day
Hi all, I'm experiencing something very odd with my website ranking at the moment. My homepage is fluctuating in rank for my main keyword by 10 pages every day and night. So, during the day i am on page 14, 15 or 16 for my main keyword yet by night i am on page 5 or 6. This trend has continued for the past 7 days now and i can't quite understand why this is. I'm using pagewash dot net to carry out manual searches and a ranking tool - both of which produce exactly the same result. Does anyone have any experience of this or why this is happening? My domain is around 8 years old and has around 50,000 pages. Any pointers would be greatly appreciated.
Algorithm Updates | | MarkHincks0 -
Transfering newly created targeted landing pages on an existing domain to a new domain
Hi - Hope someone can help me with this please I have a question regarding if its possible or advisable to create and host targeted landing pages and a blog on an existing domain, and then move these pages only to a brand new domain? The existing site has good authority and is established. Due to tight timescales in delivery I suggested creating specific landing pages and installing a blog to build authority and trust over time to target completely new keywords. Also the new pages will be helped by the existing domain authority. I've just found out client may want a whole new site, complete with new branding etc and completely new domain in time. Has anyone experienced migrating specific pages and a blog across to a completely new domain and leaving the existing site as it was. I have a whole host of concerns over this, but the main one is that I will be building relationships and content to landing pages and the blog, aswell as linking out etc and then these URL's will have a re-direct on them, going to a completely new domain.
Algorithm Updates | | McCannSEO
Also, the existing domain could lose any authority gained as although I wont only be targeting these pages, these will be the main ones being optimised and this will look unnatural. Do I? A./ Create blog and new landing pages on existing domain eg - www.testing.com/blog
www.testing.com/new-landing-pages, and then migrate these across to a brand new domain. or B./ Create the new landing pages and blog and leave them on the existing domain - period? Concerns here;
Client wants to re-vamp and have a new style and these pages will not necessarily be supported by the existing site, there is no guarantee that we are even allowed to create new pages, let alone internal linking. or C./ Bite the bullet and simply suggest a brand new domain to start with and explain the timescales and its either complete new domain or work on existing one. If anybody else has any other ideas I would really appreciate them. The client is re-branding and the company who host the existing domain, might not want to support the new pages and blog. I was hoping to provide a short term and long term solution as a brand new domain will take time to build up, especially as they are also brand new keywords we are targeting. However, I dont want the existing domain to be hit with any penalties or flag anything un-natural to Google. Many thanks in advance for any advice.. Tracey0 -
How much is Page Rank really worth?
We are in a position to purchase a domain, made of relevant keywords to our company with a current page ranking of 4 for their home page. However in looking at their analytics and other information they do not do well on significant keywords and have very low site traffic. In fact they do very, very poorly. With their high page ranking would it be relatively easy to conduct a successful SEO campaign on the domain if we were to take it over as our own and attempt to climb in the SERP's? I know Page Rank doesn't mean everything when it comes to your ranking, but 4 is relatively high in our field, so I don't really understand why they do so poorly when it comes to their actual rankings on key words.
Algorithm Updates | | absoauto0 -
Good results in Web Search, getting worse in Mobile Search
We are redirecting mobile visotors from http://www.1website.com to http://m.2website.com. 1website position in web SERPS is always the same. But mobile search brings less visitors now, 1website is loosing positions there. I know keywords volume is increasing. What could be the reason? (m.2website mobile version is high quality and have very good bounce, pageviews, time on site)
Algorithm Updates | | bele0 -
On-page Optimization
Hi, I have two campaigns and neither have any statistics for on-page optimization. Am I doing something wrong or how do I make these stats appear? I would like to improve my website. Thank you in advanced for any pointers or shared experience you may give me!
Algorithm Updates | | Pixeltistic0