Thanks.

That is what I figured just wanted to double check.

I have a Magento site and just realized we have about 800 review pages indexed. The /review directory is disallowed in robots.txt but the pages are still indexed.

From my understanding robots means it will not crawl the pages BUT if the pages are still indexed if they are linked from somewhere else.

I can add the noindex tag to the review pages but they wont be crawled.

https://www.seroundtable.com/google-do-not-use-noindex-in-robots-txt-20873.html

Should I remove the robots.txt and add the noindex? Or just add the noindex to what I already have?

I installed this extension- https://www.magentocommerce.com/magento-connect/custom-product-urls-seo.html but could not figure out how to get it to work.

In case anyone else runs across this here is what the developer sent me and it worked-

"Second way to set url key using my extension is to tick products on product list in backend and use mass action "Set Custom URL". Then apply pattern to chosen products.
Then again if you wish to chcek created url rewrites go to Catalog > Url Rewrites and see urls containing category names."

I would like my product urls to be /category/manufacturer/name/part#. This would be the only url the item uses and how the product is accessed. It would also be used for product feeds.

My first attempt was to use https://amasty.com/magento-unique-product-url.html This creates a single url but I can not customize it. Sometimes it selects the manufacturer and sometimes the category.

My second attempt was with https://www.magentocommerce.com/magento-connect/custom-product-urls-seo.html I have it installed but it doesn't change the urls.

Has anyone been able to do this successfully?

Looking at your site how sure are you that you need 70,000 pages?

For the sitemap I would stop trying to use a website and do it yourself. It looks like you are running IIS. They have a sitemap generator that you can install on a server easily and run it there. It looks like you have GoDaddy, they catch a lot of crap but I have always found their technical support to be top notch. If you can't figure out how to do it on the server I would give them a call.

1. Yes your domain gets credit for the backlinks.

2. If they change in the future and just have everything on Medium and not your subdomain you would lose the backlinks. I don't see that happening though.

Looking at your site how sure are you that you need 70,000 pages?

For the sitemap I would stop trying to use a website and do it yourself. It looks like you are running IIS. They have a sitemap generator that you can install on a server easily and run it there. It looks like you have GoDaddy, they catch a lot of crap but I have always found their technical support to be top notch. If you can't figure out how to do it on the server I would give them a call.