I have tried using them and didn´t do anything - furthermore, if you check this video out by Google themselves, you will find that using these parameters is a "hint/suggestion" as opposed to a solid directive.
http://www.youtube.com/watch?v=DiEYcBZ36po

Rel Canonical is also a hint.

But Meta Noindex,follow is a solid directive which they have to pay attention to.

Hope that helps - been there, done it got the t shirt through a lot of pain and frustration!

Hi Ian,

You are right in that Yoast Meta Robots can be cranky - I installed it and had to play around with it to get it working.

However, it does offer a very nice feature that I think is worth it - you can apply various combinations of Meta Robots directives to product pages individually - so this adds more value than just being able to do NOINDEX on reviews, wishlists, etc... pages. But install it on your dev site before trying it live.

So my solution uses both Yoast and my custom code - you check the URL for any querystrings, such as ?manufacturer etc... and apply different logic according to what you wish to be indexed or not.

Feel free to PM me.

Hi,

I am quite familiar with Magento and struggling with the SEO of this ecommerce mammoth!

As far as I am aware, you should implement the meta tag "NOINDEX, FOLLOW" on those pages that you do not want indexed - as your pages are already in the index, this is the way to go - blocking them on robots.txt does not get pages out from the index if they are already in there.

I suggest you apply some "querystring" logic to your template - you will find the page here:
app/design/frontend/default/YOURTEMPLATE/template/page/html/head.phtml

That way, you can apply the

depending on the page content.

Hope this helps you and let's stay in touch about Magento! (PM me)

Thanks @Baldea - yes, you are correct, as soon as it processes the requests for removal it allows for more to be added for removal.

In "one sitting", I managed to get 1000 URL's removed - within a few hours I could process more.

Thanks Baldea....

Yes, I have done all the above, but still got some pages stuck in Google Index that got in there - now measurements are in place to stop that happening in the future.

But using batch process of GWT to remove the URL's that already got into the index.

So how many URL's can I remove with GWT?

I'm dealing with thousands of duplicate URL's caused by the CMS...

So I am using some automation to get through them -

What is the daily limit? weekly? monthly?

Any ideas??

thanks,

Ben

Thank you to everyone that contributed.

@Zeph and @Francisco - I do use Screaming Frog, but actually, correct me if I am wrong, but it does not show a list of pages indexed, but rather pages that exist in the site - not what Google has already indexed. Thanks anyway

What I wanted was a way of creating a list of all indexed pages in Google - not a count.

But thank you all the same!

Hi,

We have an ecommerce site with around 4000 real pages. But our index count is at 47,000 pages in Google Webmaster Tools.

How can I get a list of all pages indexed of our domain? trying to locate the duplicate content.

Doing a "site:www.mydomain.com" only returns up to 676 results...

Any ideas?

Thanks,

Ben