Meta NOINDEX... how long before Google drops dupe pages?
-
Hi,
I have a lot of near dupe content caused by URL params - so I have applied:
How long will it take for this to take effect? It's been over a week now, I have done some removal with GWT removal tool, but still no major indexed pages dropped.
Any ideas?
Thanks,
Ben
-
In his case - he wants to get rid of some duplicate content only.
I see what you mean but if he is not in the situation listed in http://support.google.com/webmasters/bin/answer.py?hl=en&answer=1269119 then it might be the best bet / fastest bet.
For me personally it worked so far very well - if no robots.txt is used as that won't help on the long run as the removal tool has an expiration date of several months.
The down side of the removal tools is the same expiration date - as if you change your mind you will have some issues getting the page sinto the index.
-
You know that I think you are the bees knees, but I am going to have to disagree on this one. Even Google does not recommend using the removal rool for this application.
http://support.google.com/webmasters/bin/answer.py?hl=en&answer=1269119
Still pals?
-
There are several things that you can do to get Google to crawl your site (or your new content) quicker and more often. You should be doing all of these, but in case you're not, here is the list.
-
Create a Sitemap and submit it through Web Master Tools
-
Install Google Analytics
-
Create social accounts/update your social accounts
-
Fetch as Google Webmaster tools
-
Update your content more often (to get Google to crawl your site more frequently).
-
Adjust the crawl speed on Google Webmaster tools.
-
Check crawl errors on Google Webmaster tools. Are there sever side errors (500)?
I hope that helps!
-
-
Hi,
The best bet is the removal tool from GWT - this is the fastes way.
If your pages are static and google bot is visiting those pages once a month or once 4-5-6 months - you will need to wait until google bot is visiting those pages again, notice the nofollow and drop those from the index.
I'v e seen cases with 6 months.
Anyway you will probably see those pages drop step by step.
What you can try, although is not very straight forward is to build an xml sitemap only with those files and submit it via GWMt - sometimes google bot will think that something new happen and will visit those pages, see the no index and speed the process - but not always as I've seen in some cases that this didn't work - in some cases it did.
Again, the best bet will be the GWMT removal tool.
Cheers.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
How to get a large number of urls out of Google's Index when there are no pages to noindex tag?
Hi, I'm working with a site that has created a large group of urls (150,000) that have crept into Google's index. If these urls actually existed as pages, which they don't, I'd just noindex tag them and over time the number would drift down. The thing is, they created them through a complicated internal linking arrangement that adds affiliate code to the links and forwards them to the affiliate. GoogleBot would crawl a link that looks like it's to the client's same domain and wind up on Amazon or somewhere else with some affiiiate code. GoogleBot would then grab the original link on the clients domain and index it... even though the page served is on Amazon or somewhere else. Ergo, I don't have a page to noindex tag. I have to get this 150K block of cruft out of Google's index, but without actual pages to noindex tag, it's a bit of a puzzler. Any ideas? Thanks! Best... Michael P.S., All 150K urls seem to share the same url pattern... exmpledomain.com/item/... so /item/ is common to all of them, if that helps.
Intermediate & Advanced SEO | | 945010 -
What is your experience so far, with the new Google's Meta Description length up to 320 characters?
I updated a few home pages and some landing pages, so far so good! Although, I wish to know about other experiences, before continue updating. Thanks for your comments!
Intermediate & Advanced SEO | | Mª Verónica B.2 -
Can you create town focused landing pages for a website without breaking Google guidelines?
I recently watched a webmaster video that said that town focused landing pages are seen as doorway pages if they only exist to capture search traffic. And then I read that just because you can sell your product/service in a certain area, doesn't mean you can have a page for it on your website. Is it possible to create town focused landing pages for a website without breaking Google guidelines?
Intermediate & Advanced SEO | | Silkstream1 -
If I block a URL via the robots.txt - how long will it take for Google to stop indexing that URL?
If I block a URL via the robots.txt - how long will it take for Google to stop indexing that URL?
Intermediate & Advanced SEO | | Gabriele_Layoutweb0 -
Why is my page not showing in Google results
Hi, My website chka.org is showing up in Google but this page is not : http://www.chka.org/kickboxing-classes-nyc/ I cannot figure it out why. I submitted in manually to be crawled and it showed up for a day or two and then it disappeared again. The website is not copy pasted, it has unique content.
Intermediate & Advanced SEO | | leokadiarapczynska0 -
Ranking drop for a particular page on a particular keyword
Take a look at centerforhealthysex.com/sex-addiction. For months we were ranking in the top 3 spots with this URL for "sex addiction los angeles", even reaching #1 for a while. Late last year we redesigned and developed the site to clean up the code and redirects. We also cleaned up the internal linking structure. For years we had been ranking on "sex addiction los angeles" for the home page ... bumping around the top 5 spots, but we wanted organic traffic to go to /sex-addiction. In the Fall, we saw overall site traffic rise steadily. We made few changes to the site and none to this page or links flowing back to the page once we had achieved strong ranking -- we didn't want to mess with a good thing. Then November 27th we started losing ranking on this term and a couple others. The good news is that we gained ranking on some high volume traffic terms so overall organic traffic is reasonably strong, BUT we're not ranking on the terms where we want to rank. Centerforhealthysex.com/sex-addiction is now nowhere to be found on the target search term despite fairly strong page rank. I tried redoing and resubmitting the site map, cleaning out some potentially duplicative content but to no avail. I see no issues, errors or warnings in Webmaster Tools. We have a few medium priority fixer-uppers in SEO Moz, but we've taken care of the majority of the big stuff. What am I not seeing? Thank you!
Intermediate & Advanced SEO | | joshuakrafchin0 -
Is Google just taking long time to re-index or did I make a boo boo?...
Couple weeks ago I changed a url on my site from using underscores to using hyphens I setup a 301 redirect and added appropriate canonical to the new page. My site is crawled daily and I've done this on several other pages with good results but this page is just not being indexed right… I see my page #8 with some random title Is there some "interim index" that Google has? It's just bazaar to me, any thoughts? Thanks! - Cliff
Intermediate & Advanced SEO | | CliffAuerswald0 -
Will Google Revisit a 403 Page
Hi, We've got some pretty strict anti-scraping logic in our website, and it seems we accidentally snared a Googlebot with it. About 100 URL requests were responded to with a 403 Forbidden error. The logic has since been updated, so this should not happen again. I was just wondering if/when Googlebot will come back and try those URLs again. They are linked from other pages on the site, and they are also in our sitemap. Thanks in advance for any assistance.
Intermediate & Advanced SEO | | dbuckles0