Remove internal site SERPS from Google Index?
-
1. Internal Serp pages did not have a robots meta tag
2. As a result, client site has thousands (~4,400) of internal site SERP pages in the Google index.
3. We added the NoIndex, Follow attribute to all internal SERPS
4. We Disallowed: domain.com/internal-search-operator in Robots.txt
5. No new SERP pages are being indexed, but the other 4000 something that were already there are still in the index weeks later.
6. The pages are dynamically created and still work, so I can't use the Remove Content tool from google, because the pages don't 404.
Is there any way to get these pages out of the index besides just waiting and hoping google eventuall drops them?
Thanks
-
You can still submit a url removal request from GWT, because it checks for 1 of 3 things:
- 404 header response code
- NOINDEX meta tag
- Robots.txt disallow rule
So even if its not 404 Google will still do the removal.
-
You can create a formal request to Google using Webmaster Tools and tell them the URLs or list of URLs that you'd like removed from the index. Whether or not they actually remove them is a completely different story.
-
I should have explained it what I meant by SERPS better.
These pages are generated by doing a text search on the site. (Magento) So yes, they are product listings, but obviously most queries are different, so the dynamically created pages are all unique but useless.
Thanks for the idea about rel=canonical them back to the search page - I will look into that.
-
Note: By SERPs I'm assuming you're referring to Search Results within the site (e.g. a product listing) and not actual Google SERPs.
If so, it sounds like it could be a case for canonical. If the pages are all site.com/search.htm?searchterm=xxxx&page=y&rows=100 kind of thing you could canonical them all back down to search.htm.
If you're not familiar with canonical here's a YouMoz post that explains it pretty well:
http://www.seomoz.org/blog/complete-guide-to-rel-canonical-how-to-and-why-not
Based on my experience in the past the canonicalized pages will eventually 'disappear' from the index (not really, but Google doesn't display them anymore) in time. They would also eventually fall out already with what you've done in regards to noindex no follow etc., but I've found it takes longer.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Ad server not indexed
Hello guys, My client is using an ad server (not sure if i am allowed to tell which one so I will not for now) installed at ads.clientsite.com. It is using noindex, nofollow for preventing Google to index it but also it is blocking like 90 000 other pages on clientsite.com to be indexed/crawled. The guy that applied the noindex tag it is no longer here so I cannot ask him about the logic behind those noindex tags. How big could be the damage to clientsite.com if I will remove the noindex tag from the ad server (ads.clientsite.com? If needed I can PM you the ad server platform we are using, Regards, Ed
On-Page Optimization | | Noriel1 -
Google indexing page differently
Does google index an interal page differently depending on whether you are using a FULL url (including domain) or just a relative link? Also, is it possible that using a full URL (http://mysite.com/page.html) causes the browser to "ping" the server differently than just having the href linked to using relative links (/page.html) Could this cause server or firewall perfomance issues?
On-Page Optimization | | WebRiverGroup0 -
Different Rankings In Google Mobile
Does Google mobile have different signals? For some reason I seem to rank better with certain pages on the mobile site?
On-Page Optimization | | TP_Marketing0 -
Site Wide Link
I have just run up the link explorer on my site and discovered that every page home page link points back with the text home - I assume this is bad in terms of SEO , my site name is ccie and I assumed that it put the site wide link of ccie to the entire site, however it seems to be the breadcrumb default of home which is doing it/. www.rogerperkin.co.uk/ccie Should I be looking to change this so my top keyword points back from each page to the home page. I am running wordpress and assumed the site name was the home link on all pages. Can anyone advise the best practice? Thanks
On-Page Optimization | | rogerp0070 -
Indexed pages in Google webmaster tools
Hi Mozzers, Very quick question. Google WM tools interface has updated and I want to confirm I'm looking at the correct figure. If I look up 'Your site on the web' / 'search queries' / then the 'pages' - this is correct indexation figure yes? This differs from the 'site:' command but that's always the case. Can anyone confirm, Thanks
On-Page Optimization | | Bush_JSM0 -
On-Site Optimization and Repeat Customers
Hello, One of my clients has repeat customers. All of his surface level categories are optimized. None of his 2nd or 3rd level categories are optimized at all. Is there any harm in optimizing these 2nd or 3rd level categories. Is there any way it could cause a problem with repeat customers? I didn't think so but I want to make sure. Thanks!
On-Page Optimization | | BobGW0 -
Internal linking best practice
See example: car rental - sedans - bmw car rental - sedans - audi car rental - sedans - ford (internal links to sedans - audi, ford) or (internal links to suv - bmw) car rental - suv - bmw car rental - suv - audi car rental - suv - ford (internal links to suv- audi, ford) or (internal links to sedans- bmw...) Should I cross link only between the product page under each category or can I link between different products under different categories? From a user point of view, I think it will give him more options if he wants to choose the same brand but a bigger vehicle although I have read numerous posts saying that we should be internally linking most of the time within the same category. User experience or SEO?
On-Page Optimization | | echo10 -
Articles on our own site?
Hi Guy's Is it better to have articles on our own website under a news section, with keyword phrases that point to relevant pages or is it better to post them on our blog (that is seperate, we use blogger) and point them to relevant pages on our site? or maybe a bit of both? Thanks Daniel
On-Page Optimization | | LushDuck0