Why Google ranks a page with Meta Robots: NO INDEX, NO FOLLOW?
-
Hi guys,
I was playing with the new OSE when I found out a weird thing:
if you Google "performing arts school london" you will see w w w . mountview . org. uk at the 3rd position. The point is that page has "Meta Robots: NO INDEX, NO FOLLOW", why Google indexed it?
Here you can see the robots.txt allows Google to index the URL but not the content, in article they also say the meta robots tag will properly avoid Google from indexing the URL either.
Apparently, in my case that page is the only one has the tag "NO INDEX, NO FOLLOW", but it's the home page.
so I said to myself: OK, perhaps they have just changed that tag therefore Google needs time to re-crawl that page and de-index following the no index tag. How long do you think it will take to don't see that page indexed? Do you think it will effect the whole website, as I suppose if you have that tag on your home page (the root domain) you will lose a lot of links' juice - it's totally unnatural a backlinks profile without links to a root domain?
Cheers,
Pierpaolo
-
Hi
This is a really interesting article by Matt Cutts
https://support.google.com/webmasters/answer/96569?hl=en
I think this will help you to clarify your concerns on syntax etc
Bruce
-
Bruce, to be honest I have started thinking it's due to a syntax error, as - although I wasn't able to find something to confirm it - I suppose the right syntax is "nofollow, noindex", that site's tag is "NO FOLLOW, NO INDEX". So Google reads that tag like "follow, index" or directly discards it.
I'd like to understand if "no-follow, no-index" works, instead.
Finally, if I'm right, do you think it's an error, a CMS's glitch or something done on purpose?
I don't think it's due to WM site preferences, as a CMS usually makes all the alternative versions equals therefore that tag should be live on every possible alternative site, parked domain included.
Pierpaolo
-
Could it be that the domain WM has not set their site preferences in GWT and therefore Google are crawling alternative version?
w w w . mountview . org and mountview . org need to have their preferences set equaly in GWT for Both domain versions or Google with see them as two different sites.
Bruce
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Is my page being indexed?
To put you all in context, here is the situation, I have pages that are only accessible via an intern search tool that shows the best results for the request. Let's say i want to see the result on page 2, the page 2 will have a request in the url like this: ?p=2&s=12&lang=1&seed=3688 The situation is that we've disallowed every URL's that contains a "?" in the robots.txt file which means that Google doesn't crawl the page 2,3,4 and so on. If a page is only accessible via page 2, do you think Google will be able to access it? The url of the page is included in the sitemap. Thank you in advance for the help!
Technical SEO | | alexrbrg0 -
Does Google index internal anchors as separate pages?
Hi, Back in September, I added a function that sets an anchor on each subheading (h[2-6]) and creates a Table of content that links to each of those anchors. These anchors did show up in the SERPs as JumpTo Links. Fine. Back then I also changed the canonicals to a slightly different structur and meanwhile there was some massive increase in the number of indexed pages - WAY over the top - which has since been fixed by removing (410) a complete section of the site. However ... there are still ~34.000 pages indexed to what really are more like 4.000 plus (all properly canonicalised). Naturally I am wondering, what google thinks it is indexing. The number is just way of and quite inexplainable. So I was wondering: Does Google save JumpTo links as unique pages? Also, does anybody know any method of actually getting all the pages in the google index? (Not actually existing sites via Screaming Frog etc, but actual pages in the index - all methods I found sadly do not work.) Finally: Does somebody have any other explanation for the incongruency in indexed vs. actual pages? Thanks for your replies! Nico
Technical SEO | | netzkern_AG0 -
Google is indexing blocked content in robots.txt
Hi,Google is indexing some URLs that i don't want to be indexed and also is indexing the same URLs with https. This URLs are blocked in the file robots.txt.I've tried to block this URLs through Google WebmasterTools but Google doesn't let me do it because this URL are httpsThe file robots.txt is correct so, what can i do to avoid this content to be indexed?
Technical SEO | | elisainteractive0 -
How long does it take for Google for deindexing pages?
Hi mozzers, We just launched a mobile website(parallel) and realized that it created many duplicate content with desktop URLs. I decided to add name="robots" content="No index, No follow" /> to the entire mobile site. My only concern is that I am still seeing the mobile site indexed when it's been almost a week I added these tags. Does anyone know how long it takes google to deindex your content? Thanks
Technical SEO | | Ideas-Money-Art0 -
Home Page Not Ranking... Need an EXPERT
Hi, for about a year now, our home page seems to have been "removed" from Google (except for our branded keywords). The home page is clearly indexed, but none of the keywords for the home page rank in the top 500 (again, except for our brand, trophycentral). Other pages in the site are fine and we rank in the top 10 positions for hundreds of keywords. We are also okay on Yahoo and Bing. So the issue is the home page from non-branded words. There have been no manual penalties, but since the words, such as trophies and trophies and awards are all but gone, something is going on. It has been almost exactly a year now and I have tried everything from removing backlinks (although I still can't tell which are "bad links", to changing titles, to improving speed and structure. I have had quite a few really nice people try to help, but their suggestions don't seem to work or are too vague. I really need an expert as the impact to the business of not having a home page performing is very damaging. Thank you!!!
Technical SEO | | trophycentraltrophiesandawards0 -
Noindex Pages indexed
I'm having problem that gogole is index my search results pages even though i have added the "noindex" metatag. Is the best thing to block the robot from crawling that file using robots.txt?
Technical SEO | | Tedred0 -
Not ranking well in Google
Hi, I am new to Seomoz,I have some little doubts regarding <title>tag.</p> <p>Can i target 3 words in the title tag. Currently i am on top for one keyword, and i cant get the rest two in top positions. Here is my website, can anyone review my site please.</p> <p>xxx(dot)ridpiles(dot)com with keyword hemorrhoids treatment</p> <p>I have good amount of backlinks, but still something i am missing. I have 100% unique content.</p> <p> </p> <p>Regards</p></title>
Technical SEO | | Dexter22387874870 -
Pages plummeting in ranking
Hi all, I have a question, which i hope you can answer for me. I have a site www.betxpert.com (a danish betting site) and we have tried to do some SEO to improve conversions. One of the steps we have taken was to link to all of our bookmaker reviews in our menu (a mega menu). All of our bookmakers have an img and text link in the menu. The menu is shown on every page of the site. Since we have made this change we have been plumeting down the SERPs. For the search "betsafe" this page http://www.betxpert.com/bookmakere/betsafe is no longer in the top 50. We also added the "stars" so that the google result will show our over all review for the bookmaker, in order to stand out in the SERPs. Can anyone explain to me what the problem might be? Over extensive internal linking or?
Technical SEO | | rasmusbang0