How can I check if the FOLLOW,NOINDEX tag is working?
-
Hi everyone!
After reading about pagination practices, a few days ago we introduced the <meta name="robots" content="FOLLOW,NOINDEX" /> tag, to prevent duplicate content.
You can find an example below:
http://www.inmonova.com/en/properties?page=2
I have been checking yahoo site explorer and result pages still get indexed. My question is:
Am I doing something wrong? Is the code incorrect (follow,noindex - noindex,follow)? Or does it just take some time to have effect?
Thanks in advance.
-
Excactly what I was looking for. Thanks.
-
There are sites out there like http://www.noindexchecker.com/ that will help you double check your work
-
Thank you very much for your quick responses!
I will wait patiently to see those dulicates drop down
-
Daniel is correct. You just need to be more patient.
Websites are crawled in pieces. The crawler can grab 10% of your site each day. It depends upon the popularity of your site, the popularity of the content within your site, how well your site is linked, along with other factors.
You have done all you can for now. You will see your pages start disappearing from search results.
-
The code is correct and I see that there are 0 links to that results page - the only thing I can think of is the search engines indexed the page before you added the tag!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Can I define that one area of my website is a regualr news (no subscription) and the other part of the website is news that only subscribers can read?
Hi I have a client that have a news website, he asked me if he can define one area of his website to be a regular news that google can show on google news search results (no subscription) and the other part of the website is news that only subscribers can read? Thanks Roy
Intermediate & Advanced SEO | | kadut1 -
Canonical tags for duplicate listings
Hi there, We are restructuring a website. The website originally lists jobs that will have duplicate content. We have tried to ask the client not to use duplicates but apparently their industry is not something they can control. The recommendations I had is to have categories (which will have the idea description for a group of jobs), and the job listing pages. The job listing pages will then have canonical tags pointing to the category page as the primary URL to be indexed. Another opinion came from a third party that this can be seen as if we are tricking Google and would get penalised, **Is that even true? **Why would Google penalise for this if thats their recommendations in the first place? This third party suggested using nofollow on the links to these listings, or even not not index them all together. What are your thoughts? Thanks Issa
Intermediate & Advanced SEO | | iQi0 -
Can cookies harm your webiste?
Hi mozzers, I am doing an seo audit and one of the components of crawlability in the audit template I have is: "Disable Cookies/Make Googlebot user agent", I am not quite sure why cookies could harm your SEO? Can someone explain me what problems can arise because of cookies? Does it prevent bots to crawl your website like .js on your nav? Thanks!
Intermediate & Advanced SEO | | Ideas-Money-Art0 -
Canonical URL Tag
I have 3 websites with same content, I want to add Canonical tag to my main website. Is this also important to mentioned other duplicate URL in canonical tag in main website? or just need to just add
Intermediate & Advanced SEO | | marknorman0 -
How can Google index a page that it can't crawl completely?
I recently posted a question regarding a product page that appeared to have no content. [http://www.seomoz.org/q/why-is-ose-showing-now-data-for-this-url] What puzzles me is that this page got indexed anyway. Was it indexed based on Google knowing that there was once content on the page? Was it indexed based on the trust level of our root domain? What are your thoughts? I'm asking not only because I don't know the answer, but because I know the argument is going to be made that if Google indexed the page then it must have been crawlable...therefore we didn't really have a crawlability problem. Why Google index a page it can't crawl?
Intermediate & Advanced SEO | | danatanseo0 -
Advanced Title Tags
Looking for some advanced help here. I've been reading a lot of conflicting information on this, and I am hoping someone can clear this up. My question is regarding length and complexity of title tags. For example, my top level keywords are: IT Support, IT Services, IT Outsourcing, Help Desk, etc. I also have pages for many modified versions ex: IT Support Services, Managed IT Services, etc. I have robust pages for each. Should my title tag be: IT Support | CSM Corp. - Simple IT Support Company | CSM Corp. (Picks up a longer tail) or IT Support | Secondary Keyword | CSM Corp. Does adding secondary keywords dilute the strength of the primary keyword? If long is preferable, can someone give me an example using "IT Support"?
Intermediate & Advanced SEO | | CsmBill0 -
Link building idea - Will it work?
The SEO agency I am working for are currently trying out a unique link building tactic that i was hoping for some feedback about. Basically, we have launched a Free SEO package, and have posted it across various established social media profiles. So far we have had about 20 sign up. We gain access to their site and provide them with 4 keywords that we will be working on, we do the necessary on page optimization to get them ranking. We will then perform some very basic link building tactics on their site. In exchange for our services, we will get the following: Firstly, we will place a link on their home page linking to our own site. Secondly, we will personally write content related to their site, create a new page within their site that will contain this article. We will then have a link from this article leading to one of our own client's sites. (paying customers) What do you guys think? The Free SEO client sites have minimum PR's of 2, and we are hoping to build a database of these free clients that will be responsible for boosting the ranking of our paying customers. Is there anything that could be improved with this technique?
Intermediate & Advanced SEO | | danielblinman0 -
Should I Allow Blog Tag Pages to be Indexed?
I have a wordpress blog with settings currently set so that Google does not index tag pages. Is this a best practice that avoids duplicate content or am I hurting the site by taking eligible pages out of the index?
Intermediate & Advanced SEO | | JSOC0