Can I safely block my product listing from search? Does it even make sense?
-
Hi,
I've an ecommerce website with more than 50k urls and only 10% or so are getting crawled regularly by Google.
Product listing pages represent roughly 80% of these 50k pages.Trying to improve this, I was thinking to remove altogether all (most?) of my product listing from search (via Robot.txt) to keep only the product pages themselves and the product categories.
My organic situation since Jan 2019:
Users: 2,300,000 (of which 9% are visiting product listing pages)
Page views: 8,000,000 (of which 5% are product listing pages).Am I about to unleash armageddon (or more like harakiri) on my website by doing so or actually get Google to crawl much more relevant resources (product pages, product categories, blog content and so on)?
Thanks,
G -
Have had a lot of success with that kind of deeper logic in the past, you can usually quite easily create such rules using robots.txt wildcards
-
Thanks for your answer and the link, that's actually very useful.
What I mainly struggle with is to understand what I can prune/not and based on what criterias. And the article you've linked is helping a fair bit on that aspect.I'm thinking to start on multiple filter pages with a rule such as "block product listing pages from being indexed if at least 2 filters have been selected". And then see how it impacts the site and my crawl budget.
-
Hello GhillC,
I think we need to agree on terminology first, but it sounds like you can safely limit some of Google's access. Some people call your "product listing pages" either "refinements", "facets", or "filters". When I read "product listing pages" I typically think of what is also called a "category" page, which is a page listing multiple products. A single product page is often referred to as a product detail page (PDP).
Now that we're on the same page (pun intended), let me know if this article answers your question. It is very dated (2011) but gets the point across, which is that you need to be strategic about which facets/refinements/filters you allow to be crawled and/or indexed: https://moz.com/blog/building-faceted-navigation-that-doesnt-suck .
One more thing: 5% - 9% of traffic going directly from organic search into a page type would be considered significant for most businesses. When I look at pruning out page types, they're typically responsible for less than 0.5% of traffic from organic search.
-
A product page is a page speaking about a selected product.
Example: a page about the smartphone Samguns Supernova 30A product category is a page speaking about the category, or the type of product it falls into.
Example: smartphone or, if it is too broad, the Supernova lineA product listing is a page listing all the product refined with available criterias such as a product line.
Example: a page listing all the Samguns Supernova phones
Or a page listing all the Samguns Supernova phones with more than 128GB of HD.
Etc.Does it make more sense?
-
Can you explain the difference between the 'products listings' and the 'actual products themselves'?
You say you still want products and product categories to rank, but not product listings. But to most readers, a product listing is usually a product category or product page (so the info seems to contradict itself, which actually it may not do - just needs more explaining)
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Reviews on Product Page or Separated
Good Afternoon We currently have our individual product information pages set-up with a link through to a separate review page optimised for the term "Product A Reviews" I was reading about structured data and if I read correctly, the reviews should sit with the marked up product data so I was wondering whether to merge them back into one page. We have many reviews so the review pages are paginated in blocks of 25 My options are: Leave as it is, product info page and separate review page Merge the review content back in to the main page and have the pagination work on that page Include the first 25 reviews on the product info page then when user clicks through to page 2, 3 etc they're taken to the separated review page. In that way the product page would regularly get new content and we can still have a page specifically targeted for reviews. From the users point of view, they probably aren't even aware they're being taken to a separate reviews page so with that in mind as I'm typing this maybe they should be one page again
Technical SEO | | Ham19790 -
How can my homepage have 2 meta descriptions?
Hi all, When googling our company, I see our main page pop up with 2 different meta descriptions, depending on the search query. The situation
Technical SEO | | NHA_DistanceLearning
The search query 'nha' (on google.nl) returns the main page with a meta description that looks like a random grab from the code by Google itself, starting with 'Ik volg een cursus bij de NHA...' The search query 'nha.nl' (on google.nl) returns the main page with the proper meta description, starting with 'Aanbieder van thuisstudies met onder meer MBO-opleidingen...'. So yeah, I'd like to have the main page only appear with the proper meta description, the latter one. We did have a redirect issue (duplicate homepages) a few weeks ago and programming fixed it. Could this have something to do with a redirect? I'd love to hear your thoughts. Thanks!0 -
Google Enterprise Search Questions
Hi Everybody, A client has asked me to take a look at Google Enterprise Search for them. It has been a few years since I last fooled around with implementing a Google search box on a website, and that was the free version which included off-site results in the results. This appears to be the main page describing the paid product: http://www.google.com/enterprise/search/ I have three questions: The search testing function on the above page doesn't seem to be working. I'm typing in a URL and search term, as prompted, and the page is simply refreshing. It never provides me an example set of results. Is it working for you? This client has a moderately large e-commerce site (about 200 products). Have you implemented Google enterprise search on such a site and are you happy with its performance? The goal here is to let users search for a topic and be returned both product and informational pages. How well does this tool do this? Am I going to need to know any special types of coding (beyond html/css) to implement this? If so, what are they? If you have experience with this product, I would surely appreciate your feedback. Thank you!
Technical SEO | | MiriamEllis0 -
What caused my huge drop in search ranking?
On February 8th, 2012 my site's non-branded search traffic dropped overnight by over 80%. It appears I've been hit by a Google penalty. I submitted a reconsideration request and one of Google's staff replied letting me know it was NOT a manual penalty. So it's clearly a result of an algorithm. What is the cause? I haven't made significant changes to the website in the previous months do to being out of the country and the holidays. I'm extremely careful not to out source SEO so there is no chance of questionable link building strategies, unless my competitor launched an attack on my site. I've considered these possible causes: Duplicate content - My site had some redundancy from a marketing plan before Google Panda launched. Last month, I removed all duplicate content. Unnatural link building - I've been moving slowly my site, page by page, from adbio.com to bioworldusa.com after a brand change. Perhaps the 301 redirects triggered a flag in Google's algorithm. I've since removed all redirects to see if that will fix the issue. Poor User Experience - I recently upgraded my Drupal CMS and had to change themes. Currently my theme is an ugly, grey theme which may cause a higher than usual bounce rate. I've been trying to compensate by making sure the content is high quality. The penalty affected these website: www.bioworldusa.com (2/8/12) blog.bioworldusa.com (2/8/12) www.adbio.com (2/17/12)
Technical SEO | | bioworld1 -
Minimum text per product page
I have an ecommerce site with thousands of product pages. I am using the product details provided by the manufacturer (as with most other sites selling the same products). I have 3 questions: If I want to set my pages apart with product descriptions, what it s the minimum amount of text I can add to make them unique? The content will be from an offshore company, so it will likely not be of the best quality. Can Google determine the quality of text and evaluate it differently? I have also added product reviews to the site. Are there any other methods to make the product pages more unique or SEO friendly?
Technical SEO | | inhouseseo0 -
Multiple Google Places listings under review
I have a client with a waste removal business who had multiple listings on his Google Places account for different service locations. Over the last four months I have been creating separate listings for each separate service location, each under a different Google account and with a unique business name, address, phone number and website URL. They have all been verified by postcard and listed separately in local directories so that they have citations. As I have been creating the new listings I have also been deleted the old ones to make sure they are not flagged as duplicates. 2 months ago all the listings in the client's Google Places account were placed under review. I made some changes and submitted it for re-review but no go with Google. Now all the new listings I set up have also suddenly been placed under review. About a week ago I noticed that information in two separate Google Places listings was being mixed up - for example, the website URL for one listing was being shown in another listing. There is no connection between these two listings other than that they were both set up from the same IP address so this seems very strange. I reported this to Google and asked them to sort it out, then all of a sudden I found that ALL of the new listings had been placed under review. So now my client has no active listings at all. He can't afford to wait another 2 months for Google to review all the listings again so I am wondering whether the best course of action would just be to delete everything and start over. Any advice would be most welcome!
Technical SEO | | EssexGirl0 -
Should I Block Tag, Category, Author Pages
Just finished reviewing the first crawl of my first SEOmoz campaign for a site that I am working on. The site I"m working on uses Wordpress as a CMS, and most if not all of the warnings and notices have to do with author, category, and tag pages. Should I block these from being indexed? Why or why not?
Technical SEO | | Falconberg0 -
More products the same description but different properties
I am beginner in seo. I have development a website in prestashop. I have a problem: for more product i have the same description, but different properties: for example : http://www.icentrale.ro/45-centrale-termice-cu-tiraj-fortat-schimbator-secundar-ferroli-divatop-f-24.html and http://www.icentrale.ro/46-centrale-termice-cu-tiraj-fortat-schimbator-secundar-ferroli-divatop-f-32.html Only diffrent for this is the properties from table. Its posible to be penalized the google for duplicate content? A solution for this issue?
Technical SEO | | vilcu0