Remove internal site SERPS from Google Index?
-
1. Internal Serp pages did not have a robots meta tag
2. As a result, client site has thousands (~4,400) of internal site SERP pages in the Google index.
3. We added the NoIndex, Follow attribute to all internal SERPS
4. We Disallowed: domain.com/internal-search-operator in Robots.txt
5. No new SERP pages are being indexed, but the other 4000 something that were already there are still in the index weeks later.
6. The pages are dynamically created and still work, so I can't use the Remove Content tool from google, because the pages don't 404.
Is there any way to get these pages out of the index besides just waiting and hoping google eventuall drops them?
Thanks
-
You can still submit a url removal request from GWT, because it checks for 1 of 3 things:
- 404 header response code
- NOINDEX meta tag
- Robots.txt disallow rule
So even if its not 404 Google will still do the removal.
-
You can create a formal request to Google using Webmaster Tools and tell them the URLs or list of URLs that you'd like removed from the index. Whether or not they actually remove them is a completely different story.
-
I should have explained it what I meant by SERPS better.
These pages are generated by doing a text search on the site. (Magento) So yes, they are product listings, but obviously most queries are different, so the dynamically created pages are all unique but useless.
Thanks for the idea about rel=canonical them back to the search page - I will look into that.
-
Note: By SERPs I'm assuming you're referring to Search Results within the site (e.g. a product listing) and not actual Google SERPs.
If so, it sounds like it could be a case for canonical. If the pages are all site.com/search.htm?searchterm=xxxx&page=y&rows=100 kind of thing you could canonical them all back down to search.htm.
If you're not familiar with canonical here's a YouMoz post that explains it pretty well:
http://www.seomoz.org/blog/complete-guide-to-rel-canonical-how-to-and-why-not
Based on my experience in the past the canonicalized pages will eventually 'disappear' from the index (not really, but Google doesn't display them anymore) in time. They would also eventually fall out already with what you've done in regards to noindex no follow etc., but I've found it takes longer.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
There is a copy of our website that is ranking. How can I let Google know our website is the authentic site?
I just found another copy of my old website and have no way to take it down. Unfortunately, it's ranking so he didn't place it as a nofollow. (My boss hired someone to redevelop our website before I came on board and never finished the project). So, could this be hurting us? I tried to look to see if we were being penalized and couldn't find that we were. Also, ever since we migrated to a new domain name, our ranking is tumbling. I've redirected properly and tested to make sure they're resolving correctly and they are. I have no idea what is going on. We've virtually lost all ranking. Any help would be much appreciated.
On-Page Optimization | | npuffer790 -
Google Is Ranking the Wrong Page
Howdy Folks- I have a case where Google is ranking the wrong page for a couple of different keywords. The home page is: http://healthtn.com Most notably, we're trying to optimize the home page for "Tennessee Health Insurance" but the below page is what continually ranks for it, and does so very poorly. We used to be page two with the home page, now we are page four and it ranks the following page. http://healthtn.com/tennessee/health-insurance/student I have started directing our Internal Linking to reflect the correct anchor text but succeeded in losing ranking for the term, but am still ranking the wrong page. Any thoughts or help would be much appreciated!
On-Page Optimization | | CRO_first0 -
Site not showing up in Google search since move
Hi, hoping someone might help me with some answer(s) as to why our site no longer shows up in Google search results. Even when we type the full name and city into Google, the site is absent. Our Facebook page, LinkedIn and some backlinks show, but our site is missing. I can no longer find it in Google places. I'm sure I've done something wrong since moving from a static (flash-based) site to Wordpress. But the robots.txt file looks okay to me and the sitemap.xml file is present. Anyway, this is what happens when you ask a network technician handle website design... We know just enough to be dangerous! Here is the site in question: www.newfrontiertechnologies.com located in Shoreline WA. Any advice is much appreciated.
On-Page Optimization | | NFTECH0 -
Sitemap include all site links or just ones we want indexed?
Got a quick sitemap question. We have a clients site built in opencart and are getting ready to submit the sitmap. The default sitemap setting generates urls right off of the root. For example site.com/product. These urls are also accessible through the site itself. We prefer to give the site some depth and have structured the products so the urls are site.com/category/product. All of the product pages have canonicals including the category so we should not have to worry about duplicate content on the /product page vs the /category/product page. My question is both types of product pages are included in the sitemap at the moment. Since we don't want google to index the /product urls should we leave them off of the sitemap even though they are readily accessible from the frontend(though not linked)? Or just leave them and let the canonical tag be used in directing google as to which urls to index. Thanks in advance.
On-Page Optimization | | Whebb0 -
What are the Best On-Site SEO Practices before an E-commerce Site Goes Live?
Hello, I’m working on a client’s E-commerce website. This website is not live yet. Before the site goes live, I am curious to know what the best practices of On-site SEO are. Please let me know from which factor should I start analyze? Thanks.
On-Page Optimization | | TopLeagueTechnologies0 -
Blogposts and Google Rankings
I'm pretty new to all of this, my new website is starting to come along nicely in the SERPs, now appear on page 4 for my main key phrases were I didn't appear last week at all. I'm now on a mission to get myself ranked higher but my website is pretty much done... apart from the ongoing blogposts that I need to add, I'm a wedding photographer so every shoot is going on to it. My question, my blogposts aren't necessarily targeting my main key phrase, it might be mentioned once or twice but ultimately it'll most likely be the venue that steals the targeting. By adding the blogposts (I still have 36 to do) and using my keyphrase sparing, will this help to elevate me from page 4 in google? I know that I still need to build backlinks etc to but just something I can't seem to find an answer for on google hehe.
On-Page Optimization | | MartinWardPhoto0 -
Only homepage in Google
Hello SEOmozzers, A colleague of mine started up a site here: www.wikiboedel.nl. Sadly only the homepage is indexed in Google. It's a wordpress install. Robots.txt seems fine, all pages are on index and follow. Can't see why only the home is indexed in Google. Do you know whats going wrong? Please tell me. Tank you.
On-Page Optimization | | B.Great0 -
Where does Google say this?
Just came across this article: http://www.searchmarketingstandard.com/tips-for-avoiding-thin-content And, it states, "Google says that it will ignore pages with less than 200 words of body text " I submitted a comment to the author, but was wondering in the meantime if anyone knows where Google says this?
On-Page Optimization | | nicole.healthline0