How long does Google take to reduce the index size?
-
A few months ago, we have incorporated our custom search in our website www.ergodotisi.com . We hadn't been paying a lot of attention to our webmaster analytics, to find out a few months later than the Google Index had grown from 2K- 3K pages to one million because it was crawling all combinations of search filters. We have now followed the right instructions to add noindex meta tags and blocked most search result pages from the robot.txt. We allow indexing of some main categories by setting new seo-friendly url structures. A few weeks have passed and the index size has only reduced to 700K. How long does it take before it removes most of the duplicated search result pages from the index? Is it still crawling those pages but has not fully decided to remove most of them? How bad is this for SEO?
-
How long does it take before it removes most of the duplicated search result pages from the index?
Every site is different but I have seen it take 6 - 9 months for pages to drop out.
Is it still crawling those pages but has not fully decided to remove most of them?
It's possible. As Gaston has already pointed out, search engines will need to access those files again to see you want them noindexed.
How bad is this for SEO?
It temporarily dilutes the amount of SEO equity available to flow to pages you DO want indexed.
-
Hello there,
Did you left some time, without blocking those pages, to google bot to recrawl them?
If you implemented at the same time the noindex tag and the disallow in the robots.txt you are not letting google know that those pages should be deindexed.
Remember that blocking pages in the robots.txt avoid to be scanned again and the new robots tag is not seeng by google bot.My advise is to let google bot recrawl all those pages and wait a few days, may be 2-3 weeks. Slowly the amount of indexed pages will decrease.
Hope i've helped.
Best luck.
GR.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Virtual URL Google not indexing?
Dear all, We have two URLs: The main URL which is crawled both by GSC and where Moz assigns our keywords is: https://andipaeditions.com/banksy/ The second one is called a virtual url by our developpers: https://andipaeditions.com/banksy/signedandunsignedprintsforsale/ This is currently not indexed by Google. We have been linking to the second URL and I am unable to see if this is passing juice/anything on to the main one /banksy/ Is it a canonical? The /banksy/ is the one that is being picked up in serps/by Moz and worry that the two similar URLs are splitting the signal. Should I redirect from the second to the first? Thank you
On-Page Optimization | | TAT1000 -
HTTPS, free certificates and Google seo
As we all know, Google decided to give some weight in rankings to encrypted sites. SSL certificate providers are quite a lot out there, but there is also a free alternative (Let’s Encrypt). I've been going over some of these services and compared Godaddy's and the above certificates, and there isn't much of a difference. The question is: using a free certificate would have the same effect as a paid one? I would rather pay for one than be punished for using a free one, but free would be good too.
On-Page Optimization | | anitawapa
What's your take on this? Thank you0 -
Do these items affect Google ranking or Quality Score?
Hi community, After my first crawl of a site that I'm working to improve the SEO on, I find that I have about 500 issues regarding missing Alt Text and Title text for images on my site, as well as about 175 issues with regard to duplicate meta description, missing meta descriptions, and too short/too long meta descriptions. My client is not sure it matters to fix these items and only wants to do so if they have an affect on Google ranking or Quality Score. Does anyone know? Thanks!
On-Page Optimization | | gataninc0 -
Long Meta Titles on Dynamic Pages
What to do with long meta titles on press release pages. Unlike other pages on the site, press release pages have no physical value and are dynamically created picking data from the database. Such pages i notice are automatically picking the URL/H1 as meta title and meta description. How to shorten such meta titles and descriptions? Do such errors (related to dynamically created pages) matter? Tanveer
On-Page Optimization | | Sequelmed0 -
To Many Links & Long Titles
One of our clients currently has a number of pages that "Too many on page links", Now her menu in itself has the majority. With it being an eComerce website it has quite a few categories. How harmfull is this to search rankings. The other side of thing's, Currently the client has a large number of pages where the title of the page is the product, However her products for example could be "The pink fluffy bear 2x4 with extendable arm and voice activation ( batteries not included )" Again, how Harmfull is having a large volume of pages named like this.
On-Page Optimization | | bmkdigital0 -
Google Xml Sitemaps
Which plugin is good to use to create and submit my sitemap: sitemap from yoast or google xml sitemap plugin?
On-Page Optimization | | Sebastyan22
Which one is better? I already saw this video but I get an error when I submited it to webmaster tools and I don't know why:http://www.quicksprout.com/university/how-to-set-up-and-optimize-a-sitemap/_''Your Sitemap appears to be an HTML page. Please use a supported sitemap format instead.''_Thank you !0 -
Index.php + external site added to end of URL
Good day, I have a domain http://www.ecofriendlylink.com. I am trying to resolve the Crawl Diagnostic errors on it. I have several Duplicate Page Content errors. Example 1: (The domain happynewyou is not mine, some Comments from them have been placed on my site. Ecoshop.php is a page on my site). URL: http://www.ecofriendlylink.com Duplicate Page Content: http://www.ecofriendlylink.com/www./happynewyou.com/ecoshop.php Referrer: None. Example 2: URL: http://ecofriendlylink.com/index.php Duplicate Page Content: http://www.ecofriendlylink.com/index.php http://www.ecofriendlylink.com/www./happynewyou.com/index.php Referrer: http://ecofriendlylink.com/ Example 3: is a different problem, but still a Dup Page Error. URL: http://ecofriendlylink.com/water.php Duplicate Page Content: http://www.ecofriendlylink.com/water.php Referrer: http://ecofriendlylink.com/ water.php is a page on my main domain. The www version and the non-www version, if this a problem and something I need to overcome? So please can you advise what I need to do to get rid of this strange external domain name + index.php (as per examples 1 + 2), and explain what I'm doing wrong with Ex 3. Thank you!
On-Page Optimization | | drkevinhogan0 -
Wrong sitelinks & landing pages in Google
I've recently launched a well-optimized website with good-content category landing pages and then I've added a blog to the website (as supporting content to the landing pages, the only links pointing to the blog are from the category landing pages) What happened is that Google is now using the Blog pages as the site - sitelinks and also as the landing pages for most keywords I only have inbound links to the reg. landing pages and none to the blog, how do I get Google to change that? I know I can demote sitelink URL's in webmaster tools, but would that help me with getting the right sitelinks, it sure wont help much with the landing pages Thanks
On-Page Optimization | | Plorex
-J0