Blocking Dynamic Search Result Pages From Google
-
Hi Mozzerds,
I have a quick question that probably won't have just one solution.
Most of the pages that Moz crawled for duplicate content we're dynamic search result pages on my site. Could this be a simple fix of just blocking these pages from Google altogether? Or would Moz just crawl these pages as critical crawl errors instead of content errors?
Ultimately, I contemplated whether or not I wanted to rank for these pages but I don't think it's worth it considering I have multiple product pages that rank well. I think in my case, the best is probably to leave out these search pages since they have more of a negative impact on my site resulting in more content errors than I would like. So would blocking these pages from the Search Engines and Moz be a good idea?
Maybe a second opinion would help: what do you think I should do? Is there another way to go about this and would blocking these pages do anything to reduce the number of content errors on my site?
I appreciate any feedback! Thanks!
Andrew
-
Hi,
So the main issue with dynamic search results is that they won't have unique content, and will quite often duplicate other pages, as you've discovered. E.g. Products under £10, Products under £20, and Products under £30 would all include content from the first, and then the first and second categories.
The usual answer is to just noindex all of them, particularly if individual product pages are your focus and ranking well. Unless you specifically want to rank for 'x products under £10' then there's no issue with removing them from search results.
You have a couple of options for doing this - either by noindexing any dynamic search content via robots.txt, or Noindex,Follow, which still allows crawling, but won't display the results. In general, I'd say that Noindexing the dynamic search results with a wildcard is easiest and most effective.
If you did have something you wanted to rank - then it's be a case of setting a specific search result with some unique content describing that category etc.
Dan
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Highly interlinking a particular page shows up in Google search results?
Hi All, As we can see the below statement from Google about internal linking: "The number of internal links pointing to a page is a signal to search engines about the relative importance of that page."
Intermediate & Advanced SEO | | vtmoz
https://support.google.com/webmasters/answer/138752?hl=en So if we interlink a page highly than other pages, will it rank on search results instead of homepage? Moreover if the page have "keyword" in URL slug...like www.website.com/keyword. Thanks0 -
Pages Disappearing from Search
Hi, We have had a strongly ranking site since 2004. Over the past couple of days, our Google traffic has dropped by around 20% and some of our strong pages are completely disappearing from the rankings. They are still indexed, but having ranked number 1 are nowhere to be found. A number of pages still remain intact, but it seems they are increasingly disappearing. Where should we start to try and find out what is happening? Thanks
Intermediate & Advanced SEO | | simonukss0 -
Noindex search pages?
Is it best to noindex search results pages, exclude them using robots.txt, or both?
Intermediate & Advanced SEO | | YairSpolter0 -
Google local pointing to Google plus page not homepage
Today my clients homepage dropped off the search results page (was #1 for months, in the top for years). I noticed in the places account everything is suddenly pointing at the Google plus page? The interior pages are still ranking. Any insight would be very helpful! Thanks.
Intermediate & Advanced SEO | | stevenob0 -
Does Google make continued attempts to crawl an old page one it has followed a 301 to the new page?
I am curious about this for a couple of reasons. We have all dealt with a site who switched platforms and didn't plan properly and now have 1,000's of crawl errors. Many of the developers I have talked to have stated very clearly that the HTacccess file should not be used for 1,000's of singe redirects. I figured If I only needed them in their temporarily it wouldn't be an issue. I am curious if once Google follows a 301 from an old page to a new page, will they stop crawling the old page?
Intermediate & Advanced SEO | | RossFruin0 -
Please, help me to understand these Google results
Hello here, I am eager to know your thoughts on this. If I search on Google for "fur elise violin sheet music", we are on the second page for our sheet music title of "Fur Elise for violin and piano" (look for "virtualsheetmusic.com"). Ok, that's not very good and I still have an hard time to figure out why there are many crappy and NOT really related websites listed before us, but here is the best (weird) part... .... search now for "fur elise violin and piano sheet music" which should narrow the query further down and so increase the chances for us to get on the first page results... and in fact we are on the first page with that query, but for a different page and a different music for a different instrument! If you scroll the first page of the results, you will find our site at the end of the 1st page for our version of "Fur Elise" for "viola and piano" and not for "violin and piano"... What the heck!??! Why's that??? Doesn't make any sense too me... why if the user search for "fur elise violin and piano" Google shows "Fur Elise for viola and piano"???!! I would really appreciate any thoughts on all this. Thank you in advance!
Intermediate & Advanced SEO | | fablau0 -
Block search bots on staging server
I want to block bots from all of our client sites on our staging server. Since robots.txt files can easily be copied over when moving a site to production, how can i block bots/crawlers from our staging server (at the server level), but still allow our clients to see/preview their site before launch?
Intermediate & Advanced SEO | | BlueView13010 -
Should I prevent Google from indexing blog tag and category pages?
I am working on a website that has a regularly updated Wordpress blog and am unsure whether or not the category and tag pages should be indexable. The blog posts are often outranked by the tag and category pages and they are ultimately leaving me with a duplicate content issue. With this in mind, I assumed that the best thing to do would be to remove the tag and category pages from the index, but after speaking to someone else about the issue, I am no longer sure. I have tried researching online, but there isn't anything that provided any further information. Please can anyone with any experience of dealing with issues like this or with any knowledge of the topic help me to resolve this annoying issue. Any input will be greatly appreciated. Thanks Paul
Intermediate & Advanced SEO | | PaulRogers0