Welcome to the Q&A Forum

Sorry, everyone that responded so far. Should have been more clear here. We are well aware of all the factors mentioned above, however if you conduct some competitive analysis relative to all other sites in top 10, they are clearly getting beat out in all categories mentioned below by more than 1 site. More links from a higher PR and Domain and Page Authority, more exact match and phrase match anchor text, more linking root domains, more linking C block IP's, more external links, better internal links to the homepage with exact match anchor text, more highly optimized on-page elements, better social engagement, etc.

We are well aware of the general info mentioned above, but that is why it is so puzzling. If they are so clearly getting beat on many of these metrics, why in the world are they ranking at #1 vs. companies that are beating them on the metrics that matter?

I've done extensive research into http://www.maggiesottero.com/  and cannot come up to any definitive conclusions as to why this site is ranking #1 for the term "wedding dresses."  The page is not optimized for the keyword.

**Any thoughts? **

Thanks for responding Keri!

I can confirm that there are no parameters overriding the robots.txt within the code. I also can confirm that there is nothing amiss with the verification of the robots.txt.

Also, unfortunately, due to the nature of the client, we are unable to put the URL out there.

If you have any other thoughts, please do share. Sorry I couldn't be of more help.

Thank you.

A robots.txt file is properly implemented on the mobile site to block Googlebot from crawling, yet, when running a site: query for the site in google, it still returns over 104,000 pages from the mobile site in the index.

Why could this be happening?

Is it possible to de-index a specific URL from showing up in a specific locale?

For example, if I want to de-index http://www.example.com/category/product1 from http://www.google.co.uk but not http://www.google.com, is that possible?