How long does Google take to reduce the index size?
-
A few months ago, we have incorporated our custom search in our website www.ergodotisi.com . We hadn't been paying a lot of attention to our webmaster analytics, to find out a few months later than the Google Index had grown from 2K- 3K pages to one million because it was crawling all combinations of search filters. We have now followed the right instructions to add noindex meta tags and blocked most search result pages from the robot.txt. We allow indexing of some main categories by setting new seo-friendly url structures. A few weeks have passed and the index size has only reduced to 700K. How long does it take before it removes most of the duplicated search result pages from the index? Is it still crawling those pages but has not fully decided to remove most of them? How bad is this for SEO?
-
How long does it take before it removes most of the duplicated search result pages from the index?
Every site is different but I have seen it take 6 - 9 months for pages to drop out.
Is it still crawling those pages but has not fully decided to remove most of them?
It's possible. As Gaston has already pointed out, search engines will need to access those files again to see you want them noindexed.
How bad is this for SEO?
It temporarily dilutes the amount of SEO equity available to flow to pages you DO want indexed.
-
Hello there,
Did you left some time, without blocking those pages, to google bot to recrawl them?
If you implemented at the same time the noindex tag and the disallow in the robots.txt you are not letting google know that those pages should be deindexed.
Remember that blocking pages in the robots.txt avoid to be scanned again and the new robots tag is not seeng by google bot.My advise is to let google bot recrawl all those pages and wait a few days, may be 2-3 weeks. Slowly the amount of indexed pages will decrease.
Hope i've helped.
Best luck.
GR.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Google Reviews Plugin - Does This Impact Negatively On SEO By Diluting Optimisation
I know optimisation is now considered 'old hat' but like many old hats not only is it comfortable but it is (in my experience) still functional and working in ranking websites. Yes there are plenty of other drivers, but I still consider optimisation to be important, hence the question Google Reviews Plugin - Does This Impact Negatively On SEO By Diluting Optimisation? From my (limited in many ways) understanding this puts hundreds if not thousands of extra words on a page - so this must surely be reducing the amount of optimisation? And then could it actually lead to a decline in rankings? Has anyone had any experience in this, I would love to use the Google Reviews plugin but just wanted to be sure first... Many thanks KT
On-Page Optimization | | Markkc1 -
How do you find out all the keywords Google is ranking you for?
Hello, Is there anyway of finding out all the keywords that Google is currently ranking our website for so that we can then build on those keyword positions? Many thanks,
On-Page Optimization | | mblsolutions0 -
How does user behaviour signalled at Google affect rankings?
Hi, Just a quick question. How important are the signals received by Google on a websites user behaviour? For example: Bounce Rate, Avg Time on site, # of pages viewed, Geo of user etc Thanks.
On-Page Optimization | | followuk0 -
Google cache tool help
This link is for the Ebay Google cache - http://webcache.googleusercontent.com/search?q=cache:www.ebay.com&strip=1 I wanted to do the same for my homepage so I switched out the urls and it worked. When I try to get a different link in there such as mysite.com/category it wont work. I know my pages are indexed. Any ideas why it wont work for other pages?
On-Page Optimization | | EcommerceSite0 -
Why aren't our articles ranking in Google?
We have a website promoting Pakistani lawyers online. The website also has an articles section where we post articles reviewing different legal cases and laws. All of our articles are written by actual lawyers are high quality and unique. Website itself doesn't have large page/site authority but its not a baby website either. I can't figure out why our articles don't rank on Google. Here are few of the articles:
On-Page Optimization | | Heydarian
http://www.pakistanilawyers.com/articles/pakistan-child-custody-laws-explained-479/
http://www.pakistanilawyers.com/articles/pakistan-divorce-law-476/
http://www.pakistanilawyers.com/articles/pakistani-law-insolvency-guide-460/ I don't know whether its simply because there are not enough links pointing to our website or if there is a problem in the website itself that i can't find. Thanks for the help0 -
Why does Google no longer like our site?
Hey guys, I'm trying to figure out why the traffic and rankings have been plummeting on www.readprint.com. It's a collection of both public domain books and books on Amazon's store. If anyone can offer any pointers as to if it's duplicate content or ??? It used to get 300K visits/mo but has slowly been dropping over the last year. I appreciate anyone's expertise!
On-Page Optimization | | CoBraJones0 -
Anyone know how long it takes Google to Index new site?
Could anyone let me know how long it takes for a NEW site to be indexed in Google please? Am having some robots.txt issues and am keen to see if it got indexed. Thanks!
On-Page Optimization | | Wallander0 -
How long would it take for On-Page Optimization to have an effect on Google Rankings?
Hi there, I have a page on our website with an Interview with the author Tess Gerritsen. There has been a reasonable amount of Social Media buzz related to the page and lots of links. According to SEOMoz we are an A grade for the keyword Tess Gerritsen, we currently rank 29th on Google.co.uk for a 'tess gerritsen' search. My question is - how long would it take for any new changes to have an effect? I presume the answer would be whenever the page is crawled again. But is it wise to change one thing, then get crawled and see what the effect is, then the next day change something else and see what the effect is. Or is it wise to change one thing and then leave it a week or so to see the full effect of the change? Apologies for the vague question, if you need any more clarification just let me know. Thanks. Benj
On-Page Optimization | | Benj250