Let's say I built a directory link and it takes a while to go live. Is there a tool that will crawl the site and notify me when the link goes live?

What is the difference between Disallow: /*?utm_ and Disallow: /?utm_  ?

I am trying to block roger from crawling some UTM urls we have created, but having no luck. My robots.txt file looks like:

User-agent: rogerbot
Disallow: /?utm_source*

This does not seem to be working. Any ideas? 

Does cloudflare work on state level?

Blitzna10, I agree that we should suggest a page rather than forward them to the page we "think" they should go to. However, I have been out voted ;(.

If we have to forward users to a state specific page, what is the best method to do so? A 301, 302, JS redirect, Some other technology I am unaware of?

Currently we are using a 302.

One website I manage wants to redirect users to state specific pages based on their location. What is the best way to accomplish this?

For example a user enters the through site.com but they are in Colorado so we want to direct them to site.com/colorado.

Thanks Don for your response.

My follow up question would be what to you have has the default index page examplesite.com?

What content is displayed there?

Let's say my website can be accessed in only 3 states Colorado, Arizona and Ohio. I want to display different information to each visitor based on where they are located. For this I would also like the title to change based on their location. Not quite sure how Google we treat the title and rank the site.... Any resources you can provide would be helpful. Thanks

Thanks for all the responses. I guess in some was I was looking for some new info and to see if anyone had recently tested any of this. For example we still use a directory called Family Friendly Sites, it's a great link for a few bucks. I would be curious if any one has truly combed the web to find "Quality Directories".

After combing over several competitor sites I have found many if not the majority of their links are from directories. I am curious to know if individuals/companies/seos etc. still use directories, if so what are some of the favorites?

Thanks for your help.

I have no clue how to set this up in the Bigcommerce store platform