How can I check if the FOLLOW,NOINDEX tag is working?
-
Hi everyone!
After reading about pagination practices, a few days ago we introduced the <meta name="robots" content="FOLLOW,NOINDEX" /> tag, to prevent duplicate content.
You can find an example below:
http://www.inmonova.com/en/properties?page=2
I have been checking yahoo site explorer and result pages still get indexed. My question is:
Am I doing something wrong? Is the code incorrect (follow,noindex - noindex,follow)? Or does it just take some time to have effect?
Thanks in advance.
-
Excactly what I was looking for. Thanks.
-
There are sites out there like http://www.noindexchecker.com/ that will help you double check your work
-
Thank you very much for your quick responses!
I will wait patiently to see those dulicates drop down
-
Daniel is correct. You just need to be more patient.
Websites are crawled in pieces. The crawler can grab 10% of your site each day. It depends upon the popularity of your site, the popularity of the content within your site, how well your site is linked, along with other factors.
You have done all you can for now. You will see your pages start disappearing from search results.
-
The code is correct and I see that there are 0 links to that results page - the only thing I can think of is the search engines indexed the page before you added the tag!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Near Duplicate Title Tag Checker
Hi Everyone, I know there are a lot of tools like Siteliner, which can check the uniqueness of body copy, but are there any that can restrict the check to the title tags alone? Alternatively, is there an Excel or Google Sheets function that would allow me to do the same thing? Thanks, Andy
Intermediate & Advanced SEO | | AndyRSB0 -
Can subdomains avoid spam penalizations?
Hello everyone, I have a basic question for which I couldn't find a definitive answer for. Let's say I have my main website with URL: www.mywebsite.com And I have a related affiliates website with URL: affiliates.mywebsite.com Which includes completely different content from the main website. Also, both domains have two different IP addresses. Are those considered two completely separate domains by Google? Can bad links pointing to affiliates.mywebsite.com affect www.mywebsite.com in any way? Thanks in advance for any answer to my inquiry!
Intermediate & Advanced SEO | | fablau0 -
Can new domain extensions rank?
Hi Does anybody know if it's possible to get domains with extensions like .party or .world to rank? Even for high competitive keywords? Can they rank over .com?
Intermediate & Advanced SEO | | MikeWU0 -
Can links be hidden?
I was wondering if anyone can help me with some advice on agency work. We have just employed a new SEO agency to conduct work on one of our websites. I took a look on OSE and GWT to see if we had any new links since the agency started working (1 month ago) but there's was nothing new. When l asked for an update as to what link building efforts had been completed last month, l was told they don't give out a list of links as it could compromise the agencies techniques. They told me that they use software to hide links form link aggregators so that our competitors don't know what we are doing. Can anybody confirm that such software exists or is this agency just taking us for a ride? If there is such a software, could this not hinder what links the search engines could see? Any comments would be greatly appreciated.
Intermediate & Advanced SEO | | RobSchofield0 -
Keyword Phrases - Can You Break Them Up?
Can you break up a search query across a sentence and have Google still recognize which query you are targeting? Let's say I'm trying to rank a page for the phrase "best haircuts calgary". Is Google's algorithm advanced enough to look at page title "Best Haircuts - Where To Get Them In Calgary" and know it's targeting the query "best haircuts calgary"? If it can't do this right now, I could see it advancing to this at some point in the future, which would then change the game quite a bit in terms of how creative you can get creating pages for queries.
Intermediate & Advanced SEO | | reidsteven750 -
Canonical tag
Hi all, I have an ecommerce client and on the pages they have a drop down so customers can view via price, list etc. Natrurally I want a canonical tag on these pages, here's the question. as they have different pages of products, the canonical tag on http://www.thegreatgiftcompany.com/occassion/christmas#items-/occassion/christmas/page=7/?sort=price_asc,searchterm=,layout=grid,page=1 is to http://www.thegreatgiftcompany.com/occassion/christmas#items-/occassion/christmas/page=7. now, because the page=7 is a duplicate of the main page, shouldn't the canonical just be to the main page rather than page=7? Even when there is a canonical tag on the /Christmas/page=7 to the /Christmas page? hope that makes sense to everyone!
Intermediate & Advanced SEO | | KarlBantleman0 -
Should we use the rel-canonical tag?
We have a secure version of our site, as we often gather sensitive business information from our clients. Our https pages have been indexed as well as our http version. Could it still be a problem to have an http and an https version of our site indexed by Google? Is this seen as being a duplicate site? If so can this be resolved with a rel=canonical tag pointing to the http version? Thanks
Intermediate & Advanced SEO | | annieplaskett1 -
Can you be penalized by a development server with duplicate content?
I developed a site for another company late last year and after a few months of seo done by them they were getting good rankings for hundreds of keywords. When penguin hit they seemed to benefit and had many top 3 rankings. Then their rankings dropped one day early May. Site is still indexed and they still rank for their domain. After some digging they found the development server had a copy of the site (not 100% duplicate). We neglected to hide the site from the crawlers, although there were no links built and we hadn't done any optimization like meta descriptions etc. The company was justifiably upset. We contacted Google and let them know the site should not have been indexed, and asked they reconsider any penalties that may have been placed on the original site. We have not heard back from them as yet. I am wondering if this really was the cause of the penalty though. Here are a few more facts: Rankings built during late March / April on an aged domain with a site that went live in December. Between April 14-16 they lost about 250 links, mostly from one domain. They acquired those links about a month before. They went from 0 to 1130 links between Dec and April, then back to around 870 currently According to ahrefs.com they went from 5 ranked keywords in March to 200 in April to 800 in May, now down to 500 and dropping (I believe their data lags by at least a couple of weeks). So the bottom line is this site appeared to have suddenly ranked well for about a month then got hit with a penalty and are not in top 10 pages for most keywords anymore. I would love to hear any opinions on whether a duplicate site that had no links could be the cause of this penalty? I have read there is no such thing as a duplicate content penalty per se. I am of the (amateur) opinion that it may have had more to do with the quick sudden rise in the rankings triggering something. Thanks in advance.
Intermediate & Advanced SEO | | rmsmall0