Remove internal site SERPS from Google Index?
-
1. Internal Serp pages did not have a robots meta tag
2. As a result, client site has thousands (~4,400) of internal site SERP pages in the Google index.
3. We added the NoIndex, Follow attribute to all internal SERPS
4. We Disallowed: domain.com/internal-search-operator in Robots.txt
5. No new SERP pages are being indexed, but the other 4000 something that were already there are still in the index weeks later.
6. The pages are dynamically created and still work, so I can't use the Remove Content tool from google, because the pages don't 404.
Is there any way to get these pages out of the index besides just waiting and hoping google eventuall drops them?
Thanks
-
You can still submit a url removal request from GWT, because it checks for 1 of 3 things:
- 404 header response code
- NOINDEX meta tag
- Robots.txt disallow rule
So even if its not 404 Google will still do the removal.
-
You can create a formal request to Google using Webmaster Tools and tell them the URLs or list of URLs that you'd like removed from the index. Whether or not they actually remove them is a completely different story.
-
I should have explained it what I meant by SERPS better.
These pages are generated by doing a text search on the site. (Magento) So yes, they are product listings, but obviously most queries are different, so the dynamically created pages are all unique but useless.
Thanks for the idea about rel=canonical them back to the search page - I will look into that.
-
Note: By SERPs I'm assuming you're referring to Search Results within the site (e.g. a product listing) and not actual Google SERPs.
If so, it sounds like it could be a case for canonical. If the pages are all site.com/search.htm?searchterm=xxxx&page=y&rows=100 kind of thing you could canonical them all back down to search.htm.
If you're not familiar with canonical here's a YouMoz post that explains it pretty well:
http://www.seomoz.org/blog/complete-guide-to-rel-canonical-how-to-and-why-not
Based on my experience in the past the canonicalized pages will eventually 'disappear' from the index (not really, but Google doesn't display them anymore) in time. They would also eventually fall out already with what you've done in regards to noindex no follow etc., but I've found it takes longer.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Website Titles in Google
I currently have a Wordpress platform website and previously I noticed that when I optimized my pages, if I indicated what I wanted my page names to be (through an application like SEO Yoast) that most times, the keyword would show up exactly how I had it typed in. Recently I have noticed that the title of my website is showing in my page titles too. So for example: Before: Shoe Stores Windsor - XYZ Company Now: XYZ Company | Shoe Stores Windsor - XYZ Company In SEO practices, I know it's most often best to have the keyword you would like as close to the front of your title tag, but now this recent search adds my website title first. Plus this also seems to be making my titles longer. I know Google ultimately has the 'final say' in a page title and I have ensured that I have the "rewrite titles/descriptions option" check in Wordpress to allow me to overwrite titles, but I am hoping someone can possibly provide me with a tip or trick to avoid this in search rankings. I think it's important to have the name of my site entered through Wordpress so that any pages that I have no optimized default to the page name and site name, but the ones I have optimized seem to be showing differently all of a sudden. Any help is greatly appreciated! Thanks!
On-Page Optimization | | MainstreamMktg0 -
Why do some Keywords collapse in SERPS?
I've been working my way up SERPS with some fairly uncompetitive keywords and have been comfortable with them in the 5-10 range. This week I have watch a number of them drop back to the mid 50s. Why?
On-Page Optimization | | Zippy-Bungle0 -
Title Tags for Index Pages
What tactics do you use to change the title tags of your index page so they're not all the same? For example, if you have an index page that has 100 pages, each with the same title, what tactics do you use to give each page a unique title and how important is it?
On-Page Optimization | | felt0 -
I've just manually edited all the page titles and meta descriptions on a site, when will this show in Google results?
I've just manually edited all of the page titles, meta descriptions and optimised the copy on a client's site. I submitted this for a new crawl on Google via Webmaster Tools but when I do a Google search the old versions are still showing. Will it still take a few weeks for the new versions to show even though Google has crawled it via Webmaster?
On-Page Optimization | | aoifep0 -
Is Google indexing something I can't see on my page title?
When I do a search for my businesses website (colourpages.com) it returns a listing which is great but the title tag includes Hull Colour Pages which is our old brand name - we changed to colourpages.com 2 years ago yet Hull Colour Pages is still pulling through on the title tag. I have checked the source and it's as follows: <title>Plumbers in Hull - Reviews - colourpages.com</title> I have attached a photo which shows the issue - http://imgur.com/Cva3001 Is Google indexing it from old history that is no longer visible or am I missing something? Cva3001
On-Page Optimization | | colourpages0 -
How to treat pages that are removed?
I have a website that need be very up-to-date, I mean, pages can be published just for 30 days, after that it should be unpublished. Everyday more than 300 pages is "removed", For theses pages I am returning http code "410" (Gone), also I remove from the sitemap. Now, I am checking Google WebMasterTools and I am getting thousands of pages not found. So... My questions Does it have SEO impact? How is the best approach to treat it?
On-Page Optimization | | thobryan0 -
Our sitemap is not indexed well
Hey there, Hope you guys can help. We get the following error: Nested indexing. Another Sitemap index refers to the index of sitemaps. The thing is that we cant find the error they are talking about. Thanks!!!!
On-Page Optimization | | Comunicare0