Welcome to the Q&A Forum

Hi All, SEOMOZ is telling me I have a lot of duplicate content on my site.  The pages are not duplicate, but very similar, because the site is a directory website with a page for cities in multiple states in the US. I do not want these pages being indexed and was wanting to know the best way to go about this. I was thinking I could do a rel ="nofollow" on all the links to those pages, but not sure if that is the correct way to do this. Since the folders are deep within the site and not under one main folder, it would mean I would have to do a disallow for many folders if I did this through Robots.txt. The other thing I am thinking of is doing a meta noindex, follow, but I would have to get my programmer to add a meta tag just for this section of the site. Any thoughts on the best way to achieve this so I can eliminate these dup pages from my SEO report and from the search engine index? Thanks!

i wanted to figure out how our friend Roger Bot works. On the first crawl of one of my large sites, the number of pages crawled stopped at 10000 (due to the restriction on the pro account).  However after a few weeks, the number of pages crawled went down to about 5500.  This number seemed to be a more accurate count of the pages on our site. Today, it seems that Roger Bot has completed another crawl and the number is up to 10000 again. I know there has been no downtime on our site, and the items that we fixed on our site did not reduce or increase the number of pages we had. Just making sure there are no known issues with Roger Bot before I look deeper into our site to see if there is an issue. Thanks!

Hi All, I have been looking in the forums but could not quite find an appropriate answer to my question. I have a site that has no subdomains, in my htaccess non www redirects to www. So I would think that the subdomain metrics in seomoz would be the exact same for root and subdomain. However, it appears that I get almost all the Ticks for my site over my competition on the root domain, but do poorly in the sub domain area compared to competition.  Also, it shows that I only have 2 links for everything in the sub domain section. Any I reading something wrong, or is this correct? Thanks in advance