Well that's a small side note to your problem ;-), are you able to just set up a crawl for a sub folder? Or do you have to pass the verification at all times?

Hi Catalin,

The best way do to this is of course to include a link to the rest of the Web site (you could remove the link of course when Roger came by). But what you also could is redirect the user based on the user agent when linking wouldn't be an option.

Hope this helps!

Hi,

As far as I know this is not possible, also the answer/ question you mentioned doesn't speak about including multiple sitemap indexes within a sitemap index. He's referring to multiple sitemaps within a sitemap index which is of course very normal.

As also mentioned within the error section of the Google Webmaster Help part about the Sitemaps: http://support.google.com/webmasters/bin/answer.py?hl=en&answer=35738 there's an related error to this: Incorrect Sitemap index format: Nested Sitemap indexes.

Hope this helps!

Hi TCE,

There are two options in my opinion for this which are the best (as their are several other options including META robots etc):

1. Robots.txt: Exclude your portal via your robots.txt file.
2. HTTP Auth: Let your developers add HTTP Authentication so you have to log in to see the portal. Google won't be able to see the pages itself and so will de index them.

Hope this helps.

Hi,

Actually, there is an easy solution for this within Google Analytics. I would suggest creating a new profile for this subfolder. When you do, you're able to add a new filter like this. This will only include traffic to this particular subfolder. To me this looks like what you've been looking for.

Hope this helps!