A noindex tag specific to Googlebot would also be a good idea.
Moz Q&A is closed.
After more than 13 years, and tens of thousands of questions, Moz Q&A closed on 12th December 2024. Whilst we’re not completely removing the content - many posts will still be possible to view - we have locked both new posts and new replies. More details here.

Posts made by Kingof5
-
RE: Google indexing despite robots.txt block
-
RE: How can I get a list of every url of a site in Google's index?
Might be something you can get from the WMT API.
Also, to really see how many pages are indexed, do a site:xxxx.com search, go to the last page, include omitted results, go to the last page again, and add up how many you have. That's probably the most accurate number.
-
RE: Dev Subdomain Pages Indexed - How to Remove
Go to WMT for whatever dev site you want to remove from the index. Use the URL removal tool, but in the box just enter /, nothing else. This will remove the entire site.
-
RE: Does omitted results shown by Google always mean that website has duplicate content?
Digital Millennium Copyright Act being used here? No.
OP, it does sound like you have duplicate content issues. See what you can do to make those omitted pages more unique.
-
RE: Disavow first (and link removal outreach second) as tactic?
50% is a shockingly high success rate, way above the norm. I had a 16% success rate on one of our sites and around 35% on one of our much larger sites. I had one of the top names ever in SEO tell us that 5% would be a good success rate, though I think that's lowballing a bit.