How can I check if the FOLLOW,NOINDEX tag is working?
-
Hi everyone!
After reading about pagination practices, a few days ago we introduced the <meta name="robots" content="FOLLOW,NOINDEX" /> tag, to prevent duplicate content.
You can find an example below:
http://www.inmonova.com/en/properties?page=2
I have been checking yahoo site explorer and result pages still get indexed. My question is:
Am I doing something wrong? Is the code incorrect (follow,noindex - noindex,follow)? Or does it just take some time to have effect?
Thanks in advance.
-
Excactly what I was looking for. Thanks.
-
There are sites out there like http://www.noindexchecker.com/ that will help you double check your work
-
Thank you very much for your quick responses!
I will wait patiently to see those dulicates drop down
-
Daniel is correct. You just need to be more patient.
Websites are crawled in pieces. The crawler can grab 10% of your site each day. It depends upon the popularity of your site, the popularity of the content within your site, how well your site is linked, along with other factors.
You have done all you can for now. You will see your pages start disappearing from search results.
-
The code is correct and I see that there are 0 links to that results page - the only thing I can think of is the search engines indexed the page before you added the tag!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Working on new link structure
Hello Mozzzzzzzzzzz I'm currently working on the new link structure for our website. We currently organize our content in sub folder =Main category
Intermediate & Advanced SEO | | floaumet
= = Sub category
= = =Specialty
= = = Product main name
= = = ==Product specific name
= = = == =Manufacturer Each of them has some potential strong KW and I will be happy to use it on the URL. URL are more than 50 kw long when I use all This are very niche item for which people may refer to them through different names (potential folders) My current concerns will be Should we make long url respecting the structure (Main category)/(Sub category)/(Specialty)/(Product main name)/(Product specific name)/(maufacturer) Should I combine some like (Main category)/(Sub category)/(Specialty)/(Product main name)/(Product specific name)-(maufacturer) Should I keep them simple /(product_main name) Should I keep the main folders just to display the articles belonging to this category (Main category)/(Sub category)/(Specialty)/(Product main name) and then keep the product under a sub folder only? Any other idea?0 -
Can anyone help me figure out these sitelinks?
My company is Squatty Potty (yes, of magic unicorn fame) and I recently redid our website's navigation. We're overhauling it currently to rebuild the whole thing, but what is there should give a good idea of site hierarchy to Google I would think. The funny thing is, when you Google [squatty potty website] we do have sitelinks. But when you Google just [squatty potty] we don't. Any ideas on why sitelinks would appear on one search but not the other? I see they appear with [squatty potty logo] as well. I can't figure out how to get them to appear for my brand name search, any help appreciated!
Intermediate & Advanced SEO | | DanDeceuster0 -
Alt Tags
Hi We have lots of alt tags missing, I know they'e recommended by Google, so moving forward we will ensure we add them to product images, but should we go back and update the ones we have missing? How important is it for SEO? Has anyone tested this? Thanks
Intermediate & Advanced SEO | | BeckyKey0 -
No follow vs do follow the how to
Hi Guys, Sorry if this is an ammature question, just wanted to know I noticed a few people talking about no follows and do follows for backlinks. Is there suppose to be some way to set you website up as nofollow and dofollow for backlinks? I noticed a few people saying to make sure that some directories are nofollow, i would like to know if I can set this up for my own site as I'm a bit conscious and paranoid about others that might backlink to my site who have huge spam or negative seo etc? Any insight into this would be much appreciated Thanks all
Intermediate & Advanced SEO | | edward-may0 -
On Page Content. has a H2 Tag but should I also use H3 tags for the sub headings within this body of content
Hi Mozzers, My on page content comes under my H2 tag. I have a few subheadings within my content to help break it up etc and currently this is just underlined (not bold or anything) and I am wondering from an SEO perspective, should I be making these sub headings H3 tags. Otherwise , I just have 500-750 words of content under an H2 tag which is what I am currently doing on my landing pages. thanks pete
Intermediate & Advanced SEO | | PeteC120 -
Headline tag for images in Photoshelter
Hello! I use Photoshelter for my commercial photography website: http://www.ioansaidphotography.co.uk/ I'm trying to make it better re SEO and all that by filling as much information as I can. I'm using Picworkflow who give you a title, description and keywords for every picture.. But in Photoshelter's IPTC metadata editor, they put an SEO tag by Headline (essentially saying it's important) and not by title. Do you think it's good/useful/safe to use the info Picworkflow gave me for title and put it in Headline? PS: This is for the pictures individually and not the pages. Thanks!
Intermediate & Advanced SEO | | IoanSaid0 -
Accidently added a nofollow, noindex tag and then...
Hey guys, My first post here and ironically highlights a ridiculously stupid mistake! Ok, here's the deal... I started building links to one of my new page on a fairly good, old site (DA = >35). Before starting to build links, I added fresh new content, and while doing that, I accidentally added a "nofollow" and "noindex" tag to the page! Guess what, google DID de-index the page ! So the questions is (and YES, I did change the meta tags): Will google re-index the page with some good linking? Will it treat the page as a new, fresh page even though it was present for over a year? I had already started link building to that page, and now technically the links are pointing to a page that does not exist in the index, so once it does get re-indexed, will Google FLAG it as having too many links? Would I be ranking it as a new page? Will its previous ranking (for very few keywords) will come back? Thanks and Regards, Amod
Intermediate & Advanced SEO | | bonusjonathan0 -
Crawl Budget on Noindex Follow
We have a list of crawled product search pages where pagination on Page 1 is indexed and crawled and page 2 and onward is noindex, noarchive follow as we want the links followed to the Product Pages themselves. (All product Pages have canonicals and unique URLs) Orr search results will be increasing the sets, and thus Google will have more links to follow on our wesbite although they all will be noindex pages. will this impact our carwl budget and additionally have impact to our rankings? Page 1 - Crawled Indexed and Followed Page 2 onward - Crawled No-index No-Archive Followed Thoughts? Thanks, Phil G
Intermediate & Advanced SEO | | AU-SEO0