How long does Google take to reduce the index size?
-
A few months ago, we have incorporated our custom search in our website www.ergodotisi.com . We hadn't been paying a lot of attention to our webmaster analytics, to find out a few months later than the Google Index had grown from 2K- 3K pages to one million because it was crawling all combinations of search filters. We have now followed the right instructions to add noindex meta tags and blocked most search result pages from the robot.txt. We allow indexing of some main categories by setting new seo-friendly url structures. A few weeks have passed and the index size has only reduced to 700K. How long does it take before it removes most of the duplicated search result pages from the index? Is it still crawling those pages but has not fully decided to remove most of them? How bad is this for SEO?
-
How long does it take before it removes most of the duplicated search result pages from the index?
Every site is different but I have seen it take 6 - 9 months for pages to drop out.
Is it still crawling those pages but has not fully decided to remove most of them?
It's possible. As Gaston has already pointed out, search engines will need to access those files again to see you want them noindexed.
How bad is this for SEO?
It temporarily dilutes the amount of SEO equity available to flow to pages you DO want indexed.
-
Hello there,
Did you left some time, without blocking those pages, to google bot to recrawl them?
If you implemented at the same time the noindex tag and the disallow in the robots.txt you are not letting google know that those pages should be deindexed.
Remember that blocking pages in the robots.txt avoid to be scanned again and the new robots tag is not seeng by google bot.My advise is to let google bot recrawl all those pages and wait a few days, may be 2-3 weeks. Slowly the amount of indexed pages will decrease.
Hope i've helped.
Best luck.
GR.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Does Google penalize you for reindexing multiple URLS?
Hello, Just a quick, question! I was wanting to know if multiple page indexing (site overhaul) could cause a drop in organic traffic ranking or be penalized by Google for submitting multiple pages at one time. Thanks
On-Page Optimization | | InternetRep0 -
Google directs people to the wrong page on my site.
My site is split up into sections about different services my company offers. My problem is, when someone does a search for one of those services, My site's main page comes up rather than the page devoted to the particular service they were searching for. What can I do to make the pages about a specific service rank above my main page?
On-Page Optimization | | bradgmo0 -
Modify URL, how to re-index
hello, I have just modified URL, do I need to re-submit sitemap or something else to search engines?
On-Page Optimization | | JohnHuynh0 -
Google Drop
I started using SEOMOZ due to a sudden and huge drop in Google for two main keywords (hair bows and baby headbands). Our site (BloomingBows.com) has held a top three spot for years with these words and then in the last few months has dropped down on the first page and now they are completely off the charts. Is there any insight as to why? Also, we have been very active using the data from here in the last week or so to clean up and improve anything listed, but I am still seeing keywords drop into the 40 - 60 position and our traffic is drying up. Starting to panic and wondering if I am missing something or going about this in the wrong way. ANY insight is appreciated at this point!! Thank you!!
On-Page Optimization | | bloomingB0 -
Long url > 115
Hi, in my web code I have link to my images that are resize online and the link is very long. like this src="http://img.espectador.com/mediadelivery/?fn=&i_enc=1&i_a=L2hvbWUvZXNwZWN0YWRvci93d3cvaW1hZ2VuZXMvMjUwMTY2XzEzNDk5NTQ0NjFfY29uc3RydWNjaW9uLmpwZw==&i_cl=1&i_tr=100&i_q=70&i_rt=0&i_w=250&i_h=188&i_wtmrk=" alt="Paro parcial de Sunca" border="0"/> I have a lot of warning in my reports with this and I would like to omit this warnings How can I do that? noindex? nofollow? Thanks The original page that contain that code is this http://www.espectador.com/noticias/250166/paro-parcial-de-sunca Thanks
On-Page Optimization | | informatica8100 -
Discrepancy between SeoMoz vs Google Webmaster tools
SeoMoz reports over 70 4xx client server errors on my site, but Google Web Master Tools does not report any broken links. There are not any broken links on any of the pages that it is reporting. Could there be another reason for the 4xx errors besides broken links?
On-Page Optimization | | AndyHawkins0 -
Title Tag To Long
In the initial review of my site, I have 38 warnings of title tags to long. It also says these warnings are often penalized by search engines. In Google webmaster tools, It says I have no problems with long title tags. So am I getting penalized and do I need to shorten them? I would already have shortened them but in the past, everytime I have changed my title tag I have been penalized by the search engines. I usually get my rankings back but it can take up to a month and a half to get back to where I was.
On-Page Optimization | | tkobrien0 -
Streaming Google Places Reviews
Google no longer lets users pull an iframe of places reviews. I can't find a plugin for wordpress that will do this either. Any suggestions on how to show Google places reviews on your website? Or... should we blow it off and just go with yelp / City Search reviews?
On-Page Optimization | | John_Ellis0
