Meta Robot Tag:Index, Follow, Noodp, Noydir
-
When should "Noodp" and "Noydir" meta robot tag be used?
I have hundreds or URLs for real estate listings on my site that simply use "Index", Follow" without using Noodp and Noydir. Should the listing pages use these Noodp and Noydr also? All major landing pages use Index, Follow, Noodp, Noydir. Is this the best setting in terms of ranking and SEO.
Thanks, Alan
-
Hey,
Can anyone help me out with how I can add keywords with noodp directives?
-
I'll add further that Open Directory (DMOZ) will be shutting down March 14 (2017).
And so the internet outgrows it's training wheels....
-
Yes, for the most part "index, follow" is what you want on your pages.
But no, the "noodp, noydir" tags do not prevent you from being in the directories (though as Alan pointed out, the Yahoo one isn't around anymore), they just prevent the descriptions from being used.
Google does not always use the title and description found on your page, it sometimes chooses something it deems more relevant. Sometimes this is the description from the Open Directory Project (DMOZ). Sometimes this is not a good thing to choose.
Maybe your site was quite different when it was submitted to the directory, and the information there no longer applies. You want to tell Google not to use what is in there, so you use noodp in the header.
Whether you use or do not use "noodp, noydir", it won't hurt your rankings.
The only reason you might want to make sure to use them is if you saw unexpected content in the descriptions of your pages in the search results pages, and you had reason to believe the descriptions came from DMOZ. In that case, to prevent that from happening, you would use those additional tags, along with "index, follow".
-
Thanks Linda!!
So by adding the noydir for instance, the specific URL would not be indexed by Yahoo?
I don't quite understand the utility of this!!! I would think that something like a property listing should appear.
For instance our home page has this tag set up like this: name="robots" content="noodp,noydir"/><meta< span=""></meta<>
Wouldn't this exclude our home page from Yahoo and the Open Directory? Now I am particularly concerned because most of our major landing pages have the "noodp,noydir" tag.
Are we doing something wrong??
In term of my original question, are site has many listings and the default tag is
name="robots" content="index, follow"/><meta< span=""></meta<>Is there any downside to setting up this way?
Thanks!!! Alan
-
I'll just add that Yahoo closed the Yahoo Directory down last year.
-
Noodp= No Open Directory Project
Noydir= No Yahoo DirectoryThese are used if your website is listed in one of these directories with information you do not want used in the results pages. This might be the case if you have old, outdated listings that no longer apply. They tell robots not to use information from these sources, and they are optional.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
This one is complicated... canonicals, href lang tags and no index
Bear with me, this is complicated (I REALLY hope one of you comes along and says, no it isn't!) Scenario A client has multiple english pages, as they have a unique product offering in AUS, US, UK, NZ and also have a global site in english. Obviously there is a lot of duplicate content and they have the relevant href lang tags set-up to help Google untangle what should be ranked where. They also have rel-canonical on each page. I've set-up search console for each of the folder structures, i.e. en-us, en-gb, en-au and so on. They have an optimised page for one of their primary keywords, which ranks nowhere for this exact keyword, but this page DOES rank for 40 similar keywords. For the exact keyword, they rank 52nd, and frustratingly, it's the homepage that ranks. We know the correct page is ranking and is indexed because search console tells us so and we see the exact page appear in SERPs for the other 40 keywords. When I look at the en-us site in Search Console, it tells me that the home page is not being indexed, because a rel canonical tag is prioritising an alternative page (probably the global site) - however, the en-us homepage is showing up in rankings for a lot of their important keywords. The site has been live for 6 months and the optimised page for about 3 months. Questions 1. If search console is saying the homepage is not ranking, how is it showing up in SERPs?
Intermediate & Advanced SEO | | Algorhythm_jT
2. Why is the homepage ranking for this important keyword, when there is virtually no mention of the keyword versus the page that is almost perfect according to Moz's on-page grader?
3. Do you need href lang tags AND rel canonical on a page?
4. How long before a new page that is optimised for a keyword take to replace (and hopefully surpass) the homepage?
5. If the US is the most important market, should we guide Google to that fact using rel-canonical? Really appreciate your feedback, hivemind. Thanks0 -
Google Indexing
Hi We have roughly 8500 pages in our website. Google had indexed almost 6000 of them, but now suddenly I see that the pages indexed has gone to 45. Any possible explanations why this might be happening and what can be done for it. Thanks, Priyam
Intermediate & Advanced SEO | | kh-priyam0 -
Meta description duplication
Hello, What does google mean by don't duplicate your meta description. For example if I my meta says : Stunning golf holidays in Florida , call xxxx and book today. and I have another page with golf holiday but in ireland this time. If I write Stunning golf holidays in Ireland , call xxxx and book today. Is it considered duplicate ?
Intermediate & Advanced SEO | | seoanalytics0 -
If I block a URL via the robots.txt - how long will it take for Google to stop indexing that URL?
If I block a URL via the robots.txt - how long will it take for Google to stop indexing that URL?
Intermediate & Advanced SEO | | Gabriele_Layoutweb0 -
Tags and Categories Ranking
Hello A few times I have come across tags and categories ranking for some relevant search terms. This seems strange as all category and tag pages would have 0 external links back to them - whereas pretty much every other page on the site would have external links. In most cases thy seem to rank along with the page, for example: for the search term "voiceover recording xxxxx" The voice over recording page will rank, followed by a similar tag page... If I make the tag links 'nofollow' would that help stop this? Cheers
Intermediate & Advanced SEO | | wearehappymedia0 -
Google Not Indexing App Content
Hello Mozzers I recently noticed that there has been an increase in crawl errors reported in Google Search console & Google has stopped indexing our app content. Could this be due to the fact that there is a mismatch between the host path name mentioned within the android deeplink (within the alternate tag) and the actual URL of the page. For instance on the following desktop page http://www.example.com.au/page-1 the android deeplink points to http://www.example.com.au/android-app://com.example/http/www.example.com.au/4652374 Please note that the content on both pages (desktop & android) is same.Is this is a correct setup or am I doing something wrong here? Any help would be much appreciated. Thank you so much in advance.
Intermediate & Advanced SEO | | InMarketingWeTrust0 -
Why google index some meta titles I dont have?
Hi there, I have a problem with a website and I am desperate to find a solution because I have tried many things and nothing works! My website its: adtriboo.com Google does not find my main URL (main countro spain) www.adtriboo.com/es and I dont see this page its indexed in google. See link https://www.google.es/search?num=100&hl=es&site=&source=hp&q=site%3Aadtriboo.com&oq=site%3Aadtriboo.com&gs_l=hp.3...1189.4419.0.4586.17.17.0.0.0.0.223.1457.9j6j1.16.0...0.0...1c.1.8.hp.brTKX-zPwVI Also, google its showing some meta titles that are not in my page! For example my subfolder for the country Chile shows this title: Chile - Adtriboo but this its my real title Diseño logo, logotipos, video corporativo - adtriboo In webmaster tools everything looks good, and if I explore the webpage like google in webmaster tools the code its ok and everything lookd okay. If you see for example the URL from Chile (www.adtriboo.com/es_CL) the meta title is not the right one! Also i have a problem indexatión because i am not visible for any of my keywords even in the page 10! Please, somebody knows what happen?
Intermediate & Advanced SEO | | Comunicare0 -
Crawl Budget on Noindex Follow
We have a list of crawled product search pages where pagination on Page 1 is indexed and crawled and page 2 and onward is noindex, noarchive follow as we want the links followed to the Product Pages themselves. (All product Pages have canonicals and unique URLs) Orr search results will be increasing the sets, and thus Google will have more links to follow on our wesbite although they all will be noindex pages. will this impact our carwl budget and additionally have impact to our rankings? Page 1 - Crawled Indexed and Followed Page 2 onward - Crawled No-index No-Archive Followed Thoughts? Thanks, Phil G
Intermediate & Advanced SEO | | AU-SEO0