How can I check if the FOLLOW,NOINDEX tag is working?
-
Hi everyone!
After reading about pagination practices, a few days ago we introduced the <meta name="robots" content="FOLLOW,NOINDEX" /> tag, to prevent duplicate content.
You can find an example below:
http://www.inmonova.com/en/properties?page=2
I have been checking yahoo site explorer and result pages still get indexed. My question is:
Am I doing something wrong? Is the code incorrect (follow,noindex - noindex,follow)? Or does it just take some time to have effect?
Thanks in advance.
-
Excactly what I was looking for. Thanks.
-
There are sites out there like http://www.noindexchecker.com/ that will help you double check your work
-
Thank you very much for your quick responses!
I will wait patiently to see those dulicates drop down
-
Daniel is correct. You just need to be more patient.
Websites are crawled in pieces. The crawler can grab 10% of your site each day. It depends upon the popularity of your site, the popularity of the content within your site, how well your site is linked, along with other factors.
You have done all you can for now. You will see your pages start disappearing from search results.
-
The code is correct and I see that there are 0 links to that results page - the only thing I can think of is the search engines indexed the page before you added the tag!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Question about structuring @id schema tags
We are using JSON-LD to apply schema. My colleague had question about applying @id tags in the schema parent lists: While implementing schema, we've included @id as a parameter to both the "list" child of "ListItem" of a "BreadcrumbList" - on the same schema, we've added an @id parameter to mainContentOfPage and both @id parameters are set to the pages URL. Having this @id in both places is giving schema checker results that have the child elements of "mainContentOfPage" appearing under the "list" item. Questions: is this good or bad? Where should @id be used? What should @id be set to? Thanks for the insight!
Intermediate & Advanced SEO | | RosemaryB0 -
Organic Google Sitelinks - can I edit?
A client just contacted me saying a competitor is threatening legal action threatened against a page description in a Google sitelink (just double checked and its in the serps results too). I checked the site and the content doesn't appear on that page or anywhere else on the site. I also added a Meta description to that page to see if that will have an effect. The page is the home page and I don't really want to demote it. Is there anything else I can/should do?
Intermediate & Advanced SEO | | agua0 -
Shall i mark my tag pages as nofollow
Ran moz crawl, the tag pages are coming up with missing description Is it okay if the tag been 'noindexed', though they are not coming in as duplicate one Some examples been Gagan Modi - Blog entries tagged in finance
Intermediate & Advanced SEO | | Modi
http://www.mycarhelpline.com/index.php?option=com_easyblog&view=blogger&layout=statistic&id=128&
stat=tag&tagid=67&Itemid=91 Gagan Modi - Blog entries tagged in nissan
http://www.mycarhelpline.com/index.php?option=com_easyblog&view=blogger&layout=statistic&id=128&
stat=tag&tagid=68&Itemid=91 Gagan Modi - Blog entries tagged in dc avanti
http://www.mycarhelpline.com/index.php?option=com_easyblog&view=blogger&layout=statistic&id=128&
stat=tag&tagid=69&Itemid=91 Gagan Modi - Blog entries tagged in mahindra
http://www.mycarhelpline.com/index.php?option=com_easyblog&view=blogger&layout=statistic&id=128&
stat=tag&tagid=7&Itemid=91 Gagan Modi - Blog entries tagged in budget
http://www.mycarhelpline.com/index.php?option=com_easyblog&view=blogger&layout=statistic&id=128&
stat=tag&tagid=72&Itemid=91 Gagan Modi - Blog entries tagged in datsun
http://www.mycarhelpline.com/index.php?option=com_easyblog&view=blogger&layout=statistic&id=128&
stat=tag&tagid=73&Itemid=910 -
My warning report says I have too many on page links - 517! I can't find 50% of them but my q is about no follow
if we put 'no follow' on some of these links does that mean the search engines won't index the no follow pages even if those pages are linked to from elsewhere? no link juice will flow from the page with the (no follow) links on? Just trying to understand why my rankings have dropped so dramatically in the last 6 weeks or so since we redesigned the site, and it might be that now we have too many links on the homepage. This is the page http://www.suffolktouristguide.com/ All suggestions appreciated!
Intermediate & Advanced SEO | | SarahinSuffolk0 -
Noindex, Nofollow to previous domain
Hi, My programmer recently did a horrible mistkae by adding noindex, nofollow to our website without me noticing for two days. At the same time he did it we bought a new domain and redirected the old domain to the new domain: The Old domain is: http://www.websitebuildersworld.com and the new one is: http://www.websiteplanet.com Now unfortunatly I didn't notice the noindex,nofollow when it was on the old domain and I redirected it to websiteplanet.com before I fixed the noindex, nofollow. I fixed the problem around 10 hours ago on the new domain (www.websiteplanet.com) but the old domain didn't get indexed back (yet), so for example if you search for WebsiteBuildersWorld in google you will not reach the homepage as google deleted it because of the noindex,nofollow. My question is:
Intermediate & Advanced SEO | | Ouzan
Do you think that it will be fixed and google will retrieve websitebuildersworld homepage to his search results and then redirect it to websiteplanet? Or because I redirected websitebuildersworld.com to websiteplanet.com before letting google crawling websitebuildersworld.com without the noindex,no follow it wouldn't get indexed again? I hope I explained the problem good enough. Looking forward for your valuable replies. Thanks.0 -
Alt tags
What options do I have if all my images are pulled in by tags background images? It's a customized CMS and the designer put all images in the CSS so he would have more control over image size. I would like to somehow add description elements to the alt tags Thank, Eric
Intermediate & Advanced SEO | | SeaDrive0 -
Can this site be optimised?
I have been told that because of the technology this site was developed with it cannot be changed for example urls title and meta tags cannot be changed. why is that and what other types of sites also cannot be changed. http://www.alliedpickfords.com/Pages/Landing.aspx For example i have been told alot of online stores cannot be optimised because the urls change every time some one goes to the page therefor you cant lionk to a certain page is that true and what is the way around it if any.
Intermediate & Advanced SEO | | duncan2740 -
No index, follow vs. canonical url
We have a site that consists almost entirely as a directory of videos. Example here: http://realtree.tv/channels/realtreeoutdoorsclassics We're trying to figure out the best way to handle pagination and utility features such as sort for most recent, most viewed, etc. We've been reading countless articles on this topic, but so far have been unable to determine what might be considered the industry standard. Two solutions seem to stand out... Using the canonical url on all the sorted and paginated pages. However, after reading many blog posts, it seems that you should NEVER use the canonical url to solve the issue of paginated, and thus duplicated content because the search bots will never crawl past the first page leaving many results not in the index. (We are considering ruling this method out.) Another solution seems to be using the meta tag for noindex, follow so that a search engine like Google will crawl your directory pages but not add them to the index themselves. All links are followed so content is crawled and any passing link juice remains unchanged. However, I did see a few articles skeptical of this solution as well saying that there are always better alternatives, or that there is no verification that search engines obey this meta tag. This has placed some doubt in our minds. I was hoping to get some expert advice on these methods as it would pertain to our site. Thank you.
Intermediate & Advanced SEO | | grayloon0