Let's say I built a directory link and it takes a while to go live. Is there a tool that will crawl the site and notify me when the link goes live?

I am trying to block roger from crawling some UTM urls we have created, but having no luck. My robots.txt file looks like: User-agent: rogerbot Disallow: /?utm_source* This does not seem to be working. Any ideas?

One website I manage wants to redirect users to state specific pages based on their location. What is the best way to accomplish this? For example a user enters the through site.com but they are in Colorado so we want to direct them to site.com/colorado.

Let's say my website can be accessed in only 3 states Colorado, Arizona and Ohio. I want to display different information to each visitor based on where they are located. For this I would also like the title to change based on their location. Not quite sure how Google we treat the title and rank the site.... Any resources you can provide would be helpful. Thanks

After combing over several competitor sites I have found many if not the majority of their links are from directories. I am curious to know if individuals/companies/seos etc. still use directories, if so what are some of the favorites?

I have no clue how to set this up in the Bigcommerce store platform