Why Google ranks a page with Meta Robots: NO INDEX, NO FOLLOW?
-
Hi guys,
I was playing with the new OSE when I found out a weird thing:
if you Google "performing arts school london" you will see w w w . mountview . org. uk at the 3rd position. The point is that page has "Meta Robots: NO INDEX, NO FOLLOW", why Google indexed it?
Here you can see the robots.txt allows Google to index the URL but not the content, in article they also say the meta robots tag will properly avoid Google from indexing the URL either.
Apparently, in my case that page is the only one has the tag "NO INDEX, NO FOLLOW", but it's the home page.
so I said to myself: OK, perhaps they have just changed that tag therefore Google needs time to re-crawl that page and de-index following the no index tag. How long do you think it will take to don't see that page indexed? Do you think it will effect the whole website, as I suppose if you have that tag on your home page (the root domain) you will lose a lot of links' juice - it's totally unnatural a backlinks profile without links to a root domain?
Cheers,
Pierpaolo
-
Hi
This is a really interesting article by Matt Cutts
https://support.google.com/webmasters/answer/96569?hl=en
I think this will help you to clarify your concerns on syntax etc
Bruce
-
Bruce, to be honest I have started thinking it's due to a syntax error, as - although I wasn't able to find something to confirm it - I suppose the right syntax is "nofollow, noindex", that site's tag is "NO FOLLOW, NO INDEX". So Google reads that tag like "follow, index" or directly discards it.
I'd like to understand if "no-follow, no-index" works, instead.
Finally, if I'm right, do you think it's an error, a CMS's glitch or something done on purpose?
I don't think it's due to WM site preferences, as a CMS usually makes all the alternative versions equals therefore that tag should be live on every possible alternative site, parked domain included.
Pierpaolo
-
Could it be that the domain WM has not set their site preferences in GWT and therefore Google are crawling alternative version?
w w w . mountview . org and mountview . org need to have their preferences set equaly in GWT for Both domain versions or Google with see them as two different sites.
Bruce
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Google Not Indexing Pages (Wordpress)
Hello, recently I started noticing that google is not indexing our new pages or our new blog posts. We are simply getting a "Discovered - Currently Not Indexed" message on all new pages. When I click "Request Indexing" is takes a few days, but eventually it does get indexed and is on Google. This is very strange, as our website has been around since the late 90's and the quality of the new content is neither duplicate nor "low quality". We started noticing this happening around February. We also do not have many pages - maybe 500 maximum? I have looked at all the obvious answers (allowing for indexing, etc.), but just can't seem to pinpoint a reason why. Has anyone had this happen recently? It is getting very annoying having to manually go in and request indexing for every page and makes me think there may be some underlying issues with the website that should be fixed.
Technical SEO | | Hasanovic1 -
Blog Page Titles - Page 1, Page 2 etc.
Hi All, I have a couple of crawl errors coming up in MOZ that I am trying to fix. They are duplicate page title issues with my blog area. For example we have a URL of www.ourwebsite.com/blog/page/1 and as we have quite a few blog posts they get put onto another page, example www.ourwebsite.com/blog/page/2 both of these urls have the same heading, title, meta description etc. I was just wondering if this was an actual SEO problem or not and if there is a way to fix it. I am using Wordpress for reference but I can't see anywhere to access the settings of these pages. Thanks
Technical SEO | | O2C0 -
Different meta descriptions for same page
Hi Depending what terms I put into Google I am seeing a different meta description for exactly the same page. I have checked Umbraco CMS and everything seems in working order. Is there a reason this would be happening? Anyone else had trouble like this?
Technical SEO | | TheZenAgency0 -
How Google sees my page
When looking for crawlability issues, what is the difference between using webmaster tools Fetch as google, looking at the cached pages in google index site:mypage.com, or using spider simulator tools.
Technical SEO | | shashivzw0 -
Pages removed from Google index?
Hi All, I had around 2,300 pages in the google index until a week ago. The index removed a load and left me with 152 submitted, 152 indexed? I have just re-submitted my sitemap and will wait to see what happens. Any idea why it has done this? I have seen a drop in my rankings since. Thanks
Technical SEO | | TomLondon0 -
Does Google index has expiration?
Hi, I have this in mind and I think you can help me. Suppose that I have a pagin something like this: www.mysite.com/politics where I have a list of the current month news. Great, everytime the bot check this url, index the links that are there. What happens next month, all that link are not visible anymore by the user unless he search in a search box or google. Does google keep those links? The current month google check that those links are there, but next month are not, but they are alive. So, my question is, Does google keep this links for ever if they are alive but nowhere in the site (the bot not find them anymore but they work)? Thanks
Technical SEO | | informatica8100 -
Wrong page ranking even after fixes. Why?
Howdy, I've read a number of posts on this issue and followed all the advice I could find. My issue is this: several of our targeted keywords have the wrong page ranking which results in a loss of conversion and high bounce rate. I use the site:mydomain.com operator to see how the pages are ranking which I find really useful. One of our targeted keywords is 'wedding stationery' and the page which should rank is shop.confetti.co.uk/branch/wedding-stationery however this page ranks 3rd on our domain. I've done the following: Optimised the correct page De-optimised the ranking pages Added links from the incorrectly ranking page to the page I want to rank using keyword anchor text Added internal links to the page I want to rank from high Page Authority pages using keyword anchor text Here is a link to the SERP which shows the ranking for our domain for the 'wedding stationery' search term. I made the changes a couple of weeks ago. Any advice or explanations as to what is causing this would be greatly received. Thanks in advance, Brendan.
Technical SEO | | Confetti_Wedding0 -
Should I not Change the URL of Ranking Pages
My site currently ranks #1 or #2 for 2 separate pages on web design & SEO for my geographic location. The URLs are currently mysite.com/services/web-design/ and mysite.com/services/seo/ I'm redesigning my site and I'm taking out the "Services" page as I'm focusing on web design and SEO and lumping everything else into my "Internet Marketing" page. Because my pages for web design and SEO rank so well, should I keep the URL structure even though I don't have a "Services" page or should I just remove services and 301 redirect so I have mysite.com/web-design/ and mysite.com/seo/. I know doing a 301 redirect could hurt me in the short term but I'm wondering if I should just bite the bullet now and change it in favor of a better URL structure. What do you think?
Technical SEO | | JaredDetroit0