Google indexing Internal Search Results
-
Greeting,
Currently I have noticed that Google is starting to index our internal search page results. Should I block those pages in our robot txt file or have you ever heard of any websites that actually gained traffic or rank by letting Google index those pages?
Thanks
-
Yes you should block these pages.
This is a quote from Matt Cutts concerning this issue
Use robots.txt to prevent crawling of search results pages or other auto-generated pages that don’t add much value for users coming from search engines
Disallow: /search
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Google changing my Title
I noticed today that Google is showing a different Title in searches for the homepage. It is showing a title which I believe was active as of late last year or early January. The new title is in the title tag, in Google cache and in MOZ crawls as well. Not sure why it would still be showing a different title in the search and wanted to see if anyone can explain the reason. Thanks
On-Page Optimization | | campaigneast0 -
When making content pages to a specific page; should you index it straight away in GSC or let Google crawl it naturally?
When making content pages to a specific page; should you index it straight away in GSC or let Google crawl it naturally?
On-Page Optimization | | Jacksons_Fencing0 -
Long-tail with few searches vs. Generic with many
Our business is a contract packager/manufacturer of products sold to very prominent brands who sell through retail. For example, we make the sunscreen under a brand’s name, which you might then find on the shelf in Target or CVS. As I’ve optimized our pages, I’ve attempted to go long-tail, which has been simply to add “…contract packaging” or a variation after the particular product. So, instead of trying to compete in “sunscreen”, which would pit me against big-box distributors and prominent brands and sellers of sunscreen, I’ve optimized for “sunscreen manufacturers.” “Sunscreen” has 31K – 72K searches, with an 81 Difficulty and 67 Potential. “Sunscreen manufacturers” has a low 13 Difficulty and a decent 54 Potential, but only 51 – 100 searches. Some of my terms have only 0 – 10 searches, but I’ve been thinking that it’s better to compete for fewer but more qualified / buyer-intent searches and have generally lower Difficulty. Can you please tell me if this is a smart strategy, or if I should instead try to compete in higher-volume terms but much greater Difficulty? Thanks a lot for everyone's help.
On-Page Optimization | | Beau_W0 -
Site no indexed after a week loadbalancer, cache-control?
hi All apologies to everybody in advance my level of SEO or technical stuff is quite minimal. we have setup a new site with a top level domain sitting on multiple servers ( https.www.mysite/new/ on one and http.wwww.mysites/old/ on another) different pages,content etc. it's definitely a patchy solution until what is left in the old server will be migrated to the new one. however the new site is still not indexed after around 2 weeks. I have checke on moz and and google console ( fetch and rendering) and nothing seem to block indexing. no issue with robot.txt ( either on https.www.mysite/new/robots.txt or http.wwww.mysites/old/robots.txt) meta-robot. any idea on what could cause the problem? can it be an issue with the cache-control set as : no-store no-cache? Or the loadbalancer that is preventing google to access ? Dario
On-Page Optimization | | Mrlocicero0 -
Strange ranking occurrences in Google (NL)
Mozzers, I got a question for all of you. Recently (about 3 months ago) I launched a renewed website for a costumer of mine. Since then rankings have been improving and some decreasing a little but overall it went quite allright. _Still, we now have some issues with some new pages and I really don't know what to do any more. _ The Case:
On-Page Optimization | | JarnoNijzing
For starters lets say the company sells vacuum cleaners. We now make pages for specific product ranges e.g. Miele Diamond vacuum cleaners which in turn tells something about this product range and has links to different pages of that series, for instance the Miele Black Diamond Silent Vacuum Cleaner. Why did we do this? We already ranked for specific product pages but also wanted to rank for more general terms and thus product ranges. What happened? We now rank perfectly well for the product pages itself but for some reason the Miele Diamond Vacuum Cleaners page doesn't rank at all or not as it should. Why is this strange? Because we applied the exact same tactic for some other product ranges on the same website and it worked like a charm (part of the reason why we started to do this for all product-ranges). I could really use some help here. If you want I can message you the pagelink in PM but I won't post it here for several reasons. The Vacuum Cleaners in this example or not the real products though but used as an exemplar. I really do hope to hear from you with some advice or request for more information. Regards
Jarno0 -
Google Indexing
Hi, We recently launched a new version of our site on the Magento platform. I submitted a new sitemap and on the first crawl only 7 pages out of 132 were indexed...a few days later and we now have 107 indexed (phew). My question is this....how on earth do i find out which pages are indexed and more importantly not indexed? For all i know they might be really important ones so I need to be able to identify the missing pages so i can work on getting them indexed. Nic
On-Page Optimization | | nicc19760 -
Indexation problem
Hello, I have an online store specialized in offers and discounts (http://www.offertazo.com/) with an indexation problem. The products are not updated correctly. I think the problem is that when I publish a new offer, it doesn´t appear on the top of my page´s SERP. I would appreciate any suggestions. Best regwards.
On-Page Optimization | | ofuente0 -
Should I Remove This Subdirectory From Google?
On my site, I have a subdirectory. It posts articles from a bunch of websites that my readers are interested in & links back to all of those sites. There is no original content in it. There are over 1700 indexed pages in this subdirectory. The rest of my site has about 500 (all original content). The search engine traffic for this subdirectory only accounts for 3.9% of my sites overall visits. Should I consider removing this subdirectory? Could all the duplicate content be hurting the rankings of my legit pages? What do you all think?
On-Page Optimization | | PedroAndJobu0