How long til meta robots noindex takes effect?
-
I have a wordpress site with about 3,000 posts and over 1,000 tags. All of the tag archives are currently indexed in Google and I don't want them to be.
I just set the meta robots to no-index all the tag archives and was wondering how long it will take til they're out of the search engines?
Since there are close to 1,500 of these and they are duplicate content it would be nice to have them gone asap.
I noticed Webmaster Tools allows me to resubmit my site to index if my site has changed significantly... should I try that??
Any other advice would be greatly appreciated!
-
Thanks for the responses! The pages just got noindexed today... it took almost exactly a week.
-
I personally would update your robots.txt and then submit a sitemap with the URLs in question via GWMT - this will result in your pages being crawled very quickly (within 48 hours) and then dropped out.
I would also look at either using 301's if you see link-juice from those URLs or using 404s/410s.
I personally found that resubmitting takes longer than pushing an updated sitemap.
-
There's no set time, typically it can take a week or two, I've seen it take a month or longer though to completely noindex all desired results on bigger sites.
There's no harm in re-submtting the site, try submitting URL and all linked pages via webmaster tools, it may help get crawled a little faster.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Dark Traffic & Long URLs - Clarification
Hi everyone, I've been reading the 2017 report by Groupon and the 2017 article by Neil Patel r.e. dark traffic. Both of these articles work on the assumption that most long URLs are not direct traffic because people wouldn't type a long URL into their browser. However, what happens to me personally all the time is that I start typing a URL into the browser, and the browser brings up a list of pages I've visited recently, and I click on some super long URL that I didn't bookmark but have visited in the past. That is legitimate direct traffic, but it's a long URL. I'm just wondering if there's something flawed in my reasoning or in the reasoning of Patel and Groupon. Maybe most people aren't relying on browsers like I am, or maybe things have changed a lot in the past 3 years. What do you think? And are there any more recent resources/articles that you would recommend r.e. trying to parse out dark traffic? https://neilpatel.com/blog/dark-traffic-stealing-data/ Thanks!
Search Behavior | | LivDetrick0 -
Deceptive site warning from Google: Java script and meta descriptions deployed.
Hi all, We received a deceptive site warning from Google recently. Seems like there is a deceptive content on some pages of the website. Some pages are removed from Google index. Meta descriptions have been deployed on the site few days ago. There is also java script on the website which we use for tracking visitors like GA. I wonder what's the reason for this alert? We believe its due to the Java script. Do you think meta descriptions will harm this bad? Any ideas? Thanks
Search Behavior | | vtmoz0 -
I changed my home title and meta description but on google, i still see the old title and meta description. Whats the problem here?
I basically changed the title and meta description of my homepage and when i search on google, it still shows old. Whats the issue?
Search Behavior | | prestigeluxuryrentals.com0 -
Help with robots.txt on Magento
Hi everybody, I need your help in order to fix some problems with HTML errors and Crawling errors generated by Magento on my client's website www.casabiancheria.it I have some problems with duplicate meta informations due to the fact that there are a lot of links such as /stampe-romagnole/tovaglie-con-tovaglioli**/colore/**beige,marrone,giallo,lilla/show/all.html /stampe-romagnole/tovaglie-con-tovaglioli**/colore/**beige,marrone,lilla/show/all.html that are generated by the filter /colore/ and so they have duplicate content and meta information on them. I activated the canonicals on Magento but this hasn't fixed the problem yet. On the sitemap there are only 1 link for each product, so it seems that the canonicals are working, but bot Google Webmaster Tools and SEO Moz are giving me errors on duplicate content and meta informations. I would like to solve these problems by excluding from robots.txt all the urls that contain the filter parameters, such as /colore/, /price/, /dimensions/, etc. (take a look to the attachment). I tried different solutions in order to exclude these links from robots, but I wasn't able to succeed. Below you can find my current robots.txt... can someone help me in order to write the correct form of this file and finally exclude all these urls generated by filters on Magento? Finally, is it worth it to exclude also the images from Magento? (take a look to the final lines of the robots below). Thank you very much for your help! Alberto User-agent: *
Search Behavior | | OptimizedGroup
Disallow: /CVS
Disallow: /.svn$
Disallow: /.idea$
Disallow: /.sql$
Disallow: /.tgz$
Disallow: /w1nL1f3L0g1c/
Disallow: /app/
Disallow: /downloader/
Disallow: /errors/
Disallow: /includes/
Disallow: /lib/
Disallow: /pkginfo/
Disallow: /shell/
Disallow: /var/
Disallow: /404/
Disallow: /cgi-bin/
Disallow: /magento/
Disallow: /report/
Disallow: /scripts/
Disallow: /shell/
Disallow: /skin/
Disallow: /stats/
Disallow: /api.php
Disallow: /cron.php
Disallow: /cron.sh
Disallow: /error_log
Disallow: /get.php
Disallow: /install.php
Disallow: /LICENSE.html
Disallow: /LICENSE.txt
Disallow: /LICENSE_AFL.txt
Disallow: /README.txt
Disallow: /RELEASE_NOTES.txt
Disallow: /?dir
Disallow: /?dir=desc
Disallow: /?dir=asc
Disallow: /?limit=all
Disallow: /?mode*
Disallow: /index.php/
Disallow: /?SID=
Disallow: /checkout/
Disallow: /onestepcheckout/
Disallow: /customer/
Disallow: /customer/account/
Disallow: /customer/account/login/
Disallow: /catalogsearch/
Disallow: /catalog/product_compare/
Disallow: /catalog/category/view/
Disallow: /catalog/product/view/
Disallow: /cgi-bin/
Disallow: /cleanup.php
Disallow: /apc.php
Disallow: /memcache.php
Disallow: /phpinfo.php
Disallow: /control/
Disallow: /customize/
Disallow: /newsletter/
Disallow: /poll/
Disallow: /review/
Disallow: /sendfriend/
Disallow: /tag/
Disallow: /wishlist/
Disallow: /catalog/product/gallery/
Disallow: /?*
Disallow: //colore/
Disallow: //price/
Disallow: //misura/
Disallow: //marca/
Disallow: //sort-by/
Disallow: //combinazione/
Disallow: /*/seleziona-colore/
Disallow: /colore/
Disallow: /price/
Disallow: /misura/
Disallow: /marca/
Disallow: /sort-by/
Disallow: /combinazione/
Disallow: /seleziona-colore/
Disallow: /*colore/
Disallow: /*price/
Disallow: /*misura/
Disallow: /*marca/
Disallow: /*sort-by/
Disallow: /*combinazione/
Disallow: /*seleziona-colore/ UmuEX4z0 -
GWMT - "Tag Site For Child Directed Treatment" Effect On Search / Rankings?
Hi All, We have a client who has been directed to tag their site for "Child Directed Treatment" in Webmaster tools to comply with AdExchange policies. The site is, generally speaking, directed at those between the ages of 13 and 16 along with their parents, but does NOT collect any data (No sign in, login, signups etc). You can find out more about the specific tag here (unfortunately not much more about it) https://support.google.com/webmasters/answer/3221080?hl=en Our concern is that we have never heard of this specific tag, and our client is asking us to let them know if that this will have no effect on search traffic or ranking. I can't find much in the way of anyone who HAS implemented this tag and the effects it has had on their site. They are ad supported, receive millions of unique hits a month, and the majority of their traffic is from branded keywords. Would love to hear from anyone with ANY experience or thoughts on this process and what to be aware of. Your assistance is muchly appreciated.
Search Behavior | | SearchMarketers0 -
Disallow robots on a url effect?
Hello, I am using wordpress and on some of my top tag urls e.g : http://www.designzzz.com/tag/brushes/ there is an avg page rank of 4. I was reading somewhere that my huge jump in not selected count in index status in GWT is becuase of tags/categories urls. So i added disallow in my robots.txt for the url /tag What sort of effect will it have on my tag urls rankings or PR ?
Search Behavior | | wickedsunny10 -
Google Location - Taking Away Our National Reach?
Hey, I was just noticing that we achieve #2 ranking on Google for one of our customers for one of their primary keyword phrases. But then I noticed the traffic analytics were not matching what we should expect from that keyword phrase. Then I noticed, in using "Chrome's Incognito Window", that our location was automatically selected for our main geographical city area. I then went and changed that location from Denver, to San Diego & Also Chicago, just to see what would happen, and I noticed we instantly dropped from #2 to #7 when changing our location. I don't know what my question is, but I guess I feel like that is preventing us from achieving the results we need to sell ecommerce products. Is there any info on this or suggestions anyone has on how to tackle this issue? It feels like Google is pulling the rug out from underneath our feet and trying to spread rankings more to localized areas, rather than offering someone the opportunity to capitalize on good rankings for a national audience. I understand why they would do it, and I don't say I disagree. But it just seems to affect our work as SEO's doesn't it? Since we can't be as effective for customers that have a global audience instead of strictly a localized one. I'm curious to see what people have to say about this issue. Thanks!
Search Behavior | | JerDoggMckoy0 -
Studies on influence of meta description on CTR
After having answered quite a lot of questions here, I figured it was about time to ask one of my own. Can anybody point me to decent (experimental) research articles or blogs that actually show variations in meta descriptions influence the Click Through Rate (CTR) of searchers? On dozens of websites on the internet it is stated that 'meta descriptions affect CTR', but (good scientific) sources for those statements are nowhere to be found. The only research I can find that comes closest to providing any evidence is a translated study by dynamical.biz, which states that searchers LOOK a lot at the meta description, but this study (atleast in the translation) mentions nothing of searchers actually CLICKING it. Any help would be greatly appreciated!
Search Behavior | | Theo-NL0