How long does Google take to reduce the index size?
-
A few months ago, we have incorporated our custom search in our website www.ergodotisi.com . We hadn't been paying a lot of attention to our webmaster analytics, to find out a few months later than the Google Index had grown from 2K- 3K pages to one million because it was crawling all combinations of search filters. We have now followed the right instructions to add noindex meta tags and blocked most search result pages from the robot.txt. We allow indexing of some main categories by setting new seo-friendly url structures. A few weeks have passed and the index size has only reduced to 700K. How long does it take before it removes most of the duplicated search result pages from the index? Is it still crawling those pages but has not fully decided to remove most of them? How bad is this for SEO?
-
How long does it take before it removes most of the duplicated search result pages from the index?
Every site is different but I have seen it take 6 - 9 months for pages to drop out.
Is it still crawling those pages but has not fully decided to remove most of them?
It's possible. As Gaston has already pointed out, search engines will need to access those files again to see you want them noindexed.
How bad is this for SEO?
It temporarily dilutes the amount of SEO equity available to flow to pages you DO want indexed.
-
Hello there,
Did you left some time, without blocking those pages, to google bot to recrawl them?
If you implemented at the same time the noindex tag and the disallow in the robots.txt you are not letting google know that those pages should be deindexed.
Remember that blocking pages in the robots.txt avoid to be scanned again and the new robots tag is not seeng by google bot.My advise is to let google bot recrawl all those pages and wait a few days, may be 2-3 weeks. Slowly the amount of indexed pages will decrease.
Hope i've helped.
Best luck.
GR.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Can you transcribe your youtube video to just google?
YouTube videos have been very effective for us on our site. The only problem is they have taken part of a fair amount of our content so to google our pages may seem to have minimal content. Transcribing each video and including that on the page would take away from the look of the page and clutter it. Is there a way to let google know the content without having to include it on the page? You can find an example page at https://www.waikoloavacationrentals.com/halii-kai-rentals/
On-Page Optimization | | RobDalton0 -
Does hover over content index well
i notice increasing cases of portfolio style boxes on site designs (especially wordpress templates) where you have an image and text appears after hover over (sorry for my basic terminology). does this text which appears after hover over have much search engine value or as it doesnt immediately appear on pageload does it carry slightly less weight like tabbed content? any advice appreciated thanks neil
On-Page Optimization | | neilhenderson0 -
SEO optimization for popular long-tail content
I was wondering if you all have tips / best practices to SEO-optimize new pages created for popular long-tail queries, as well as recommendations to assure we don't have duplicate content issues.
On-Page Optimization | | CuriosityMedia0 -
What does Google consider a "Duplicate Title Tag?"
Do the title tags have to be exactly the same, or can they have some of the same keywords but different context? Hypothetical example: Home Page = Raising a Kitten, Tips & Tricks for a Healthy Cat Sub-Page = How to Cat-Proof your Home when Raising a Kitten Since both title tags has "raising a kitten," "cat" and "tips" would this be considered a "Duplicate Title Tag" even though the pages have completely different content in them? Thanks in advance!
On-Page Optimization | | Scratch_MM0 -
Website Changes Updated in Google...
How long does it take for Google to recognize SEO changes that I have made to my website?
On-Page Optimization | | AubbiefromAubenRealty0 -
Google images hits distorting my results. What to do.
Hit from google images seem to be distroting my results. I sell airport taxis so want rid of any hots that came through google images as there no buying intent Aanlytics shows (when i click in) Traffic Sources > Search Engine Optimisation > Quires 250 clicks All of which came from quires related to generic taxi terms which I do (unfortunately) rank for in search. I imagine these generated because I have a taxi cab image in page one of google images. So when people search for a picture of a taxi they click mine. However in SEO MOZ the traffic data tab shows: google = 219 clicks images.google = 3 clicks This should be the other way round shouldn't it?
On-Page Optimization | | smashseo0 -
Best Way to Add Google Map to Site
My site is built with WordPress. I want to add our business location in the contact page using Google Map. What is the best way to do this? There is many plugins out there for Word Press do I need to use one ? Hopw about Webmaster tools, does it need to be submit somewhere in there? When it is done properly, will Google show our store location with a map in Goolgle search results? I saw some store result showing the map & business hours, How to do this? Thank you for your help. BigBlaze
On-Page Optimization | | BigBlaze2050 -
Can A Blog post impact negatively on Google rankings?
We used to rank fairly highly on Google for our preferred search term, but once we introduced a blog (or rather the blog excerps) onto our home page we dropped from page 1 to page 3 for our preferred search term. We have made the assumption this may be down to diluting of keywords and therefor the key phrase or message to the Search Engines was not as clear as it was before. Is this generally accepted as being the case ? If so - should each and every blog post excerpt start with the key seo search phrase to maintain the integrity of that search phrase ? or perhaps even better still is it best to have the blog on a dedicated page only with no excerpts on the home page ? We are using Wordpress and also using multiple categories within the blog - is it perhaps best to just have all blog postings on the one page and use TAGS more often? Thanksing you in advance.
On-Page Optimization | | kiswebsltd0