Can I safely block my product listing from search? Does it even make sense?
-
Hi,
I've an ecommerce website with more than 50k urls and only 10% or so are getting crawled regularly by Google.
Product listing pages represent roughly 80% of these 50k pages.Trying to improve this, I was thinking to remove altogether all (most?) of my product listing from search (via Robot.txt) to keep only the product pages themselves and the product categories.
My organic situation since Jan 2019:
Users: 2,300,000 (of which 9% are visiting product listing pages)
Page views: 8,000,000 (of which 5% are product listing pages).Am I about to unleash armageddon (or more like harakiri) on my website by doing so or actually get Google to crawl much more relevant resources (product pages, product categories, blog content and so on)?
Thanks,
G -
Have had a lot of success with that kind of deeper logic in the past, you can usually quite easily create such rules using robots.txt wildcards
-
Thanks for your answer and the link, that's actually very useful.
What I mainly struggle with is to understand what I can prune/not and based on what criterias. And the article you've linked is helping a fair bit on that aspect.I'm thinking to start on multiple filter pages with a rule such as "block product listing pages from being indexed if at least 2 filters have been selected". And then see how it impacts the site and my crawl budget.
-
Hello GhillC,
I think we need to agree on terminology first, but it sounds like you can safely limit some of Google's access. Some people call your "product listing pages" either "refinements", "facets", or "filters". When I read "product listing pages" I typically think of what is also called a "category" page, which is a page listing multiple products. A single product page is often referred to as a product detail page (PDP).
Now that we're on the same page (pun intended), let me know if this article answers your question. It is very dated (2011) but gets the point across, which is that you need to be strategic about which facets/refinements/filters you allow to be crawled and/or indexed: https://moz.com/blog/building-faceted-navigation-that-doesnt-suck .
One more thing: 5% - 9% of traffic going directly from organic search into a page type would be considered significant for most businesses. When I look at pruning out page types, they're typically responsible for less than 0.5% of traffic from organic search.
-
A product page is a page speaking about a selected product.
Example: a page about the smartphone Samguns Supernova 30A product category is a page speaking about the category, or the type of product it falls into.
Example: smartphone or, if it is too broad, the Supernova lineA product listing is a page listing all the product refined with available criterias such as a product line.
Example: a page listing all the Samguns Supernova phones
Or a page listing all the Samguns Supernova phones with more than 128GB of HD.
Etc.Does it make more sense?
-
Can you explain the difference between the 'products listings' and the 'actual products themselves'?
You say you still want products and product categories to rank, but not product listings. But to most readers, a product listing is usually a product category or product page (so the info seems to contradict itself, which actually it may not do - just needs more explaining)
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Page disappears from Google search results
Hi, I recently encountered a very strange problem.
Technical SEO | | JoelssonMedia
One of the pages I published in my website ranked very well for a couple of days on top 5, then after a couple of days, the page completely vanished, no matter how direct I search for it, does not appear on the results, I check GSC, everything seems to be normal, but when checking Google analytics, I find it strange that there is no data on the page since it disappeared and it also does not show up on the 'active pages' section no matter how many different computers i keep it open. I have checked to page 9, and used a couple of keyword tools and it appears nowhere! It didn't have any back links, but it was unique and high quality. I have checked on the page does still exist and it is still readable. Has this ´happened to anyone before? Any thoughts would be gratefully received.0 -
Product Schema Markup for All Products
Hi Team, Google search console used to allow you to use their structured data markup helperhttps://www.google.com/webmasters/markup-helper/u/0/ to markup multiple product pages at once that were similar. I do not see this feature anymore with the new search console. Does anyone have a recommendation for marking up multiple product pages without having to have schema markup firing in GTM for each product page?
Technical SEO | | agrier0 -
301 redirect and search engines
How long until 301 redirects get recognized by search engines? I noticed my link on Google isn't forwarding over to my new domain even after the 301 redirect. If I go to the site directly, the 301 redirect works. Anyone know how long it takes for search engines to pick it up? Thanks!
Technical SEO | | timeintopixels0 -
When keywords are on the top of the google search engine then what to do ?
My two keywords are on the top of my desired market place that means google.co.uk . So now what should I do to sustain this position???
Technical SEO | | JohnDooley0 -
Summarize your question.Sitemap blocking or not blocking that is the question?
Hi from wet & overcast wetherby UK 😞 Ones question is this... " Is the sitemap plus boxes blocking bots ie they cant pass on this page http://www.langleys.com/Site-Map.aspx " Its just the + boxes that concern me, i remeber reading somewherte javascript nav can be toxic. Is there a way to test javascript nav set ups and see if they block bots or not? Thanks in advance 🙂
Technical SEO | | Nightwing0 -
Explain this search result
Hi folks, I came across a strange search result. Search on Google Australia for "income portfolio". http://www.google.com.au/search?sourceid=chrome&ie=UTF-8&q=income+portfolio See the first result? It's a login page. How is that search result showing? And in position #1! Where is it getting its title and descriptions tags from? Does Google have a way to somehow see what is behind the login? Appreciate your thought.
Technical SEO | | scotennis0 -
Does HTTPS Only make a impact on SEO?
Hi. I run a site that's SSL only. (Using a 301 redirect to redirect traffic from http:// to https://). This might be a stupid question but i can't seem to find any conclusive answers to the question by searching. Does this negatively affect the search engine ranking of the site? Regards,
Technical SEO | | Host1
Eivind1 -
Search Result Page, Index or Not?
I believe Google doesn't want to index and show other search result pages in there SERP.
Technical SEO | | DigitalJungle
So instead of adding "noindex, follow" tag i have changed the url in my search result page like this: Original
http://www.mysite.com/kb-search.aspx?=travelguide&type=wiki&s=3 To
http://www.mysite.com/travelguide/attraction-guide.html And the search result page contains the title of the articles, a short descriptions (300 chars.) and a link to the articles. Does it help? Or should i add noindex, follow tag? Helps Please?0