Robots.txt for subdomain

[Partouter]

Hi there Mozzers!

I have a subdomain with duplicate content and I'd like to remove these pages from the mighty Google index. The problem is: the website is build in Drupal and this subdomain does not have it's own robots.txt.

So I want to ask you how to disallow and noindex this subdomain. Is it possible to add this to the root robots.txt:

User-agent: *
Disallow: /subdomain.root.nl/

User-agent: Googlebot
Noindex: /subdomain.root.nl/

Thank you in advance!

Partouter

[de4e]

Robots.txt work only for subdomain where it placed.

You need to create separate robots.txt for each sub-domain, Drupal allow this.

it must be located in the root directory of your subdomain Ex: /public_html/subdomain/ and can be accessed at http://subdomain.root.nl/robots.txt.

Add the following lines in the robots.txt file:

User-agent: *

Disallow: /As alternative way you can use Robots <META> tag on each page, or use redirect to directory root.nl/subdomain and disallow it in main robots.txt. Personally i don't recommend it.

[stevecounsell]

Not sure how your server is configured but mine is set up so that subdomain.mydomain.com is a subdirectory like this:

http://www.mydomain.com/subdomain/

in robots.txt you would simply need to put

User-agent: *
Disallow: /subdomain/

Others may have a better way though.

HTH

Steve