Given that I am currently using a bot sniffer...How can I identify the MOZ bot in order to whitelist it?
-
MOZ is currently blocked from crawling my sites because I use a bot sniffer.
Does anyone know how I can properly identify the MOZ bot in order to whitelist it?
MOZ is using Amazon web services and thus employs thousands of dynamic IPs to crawl.
-
Hi Ryan,
We only block by specific IPs because anyone can spoof a user agent. While i honestly appreciate your effort, could you please put me in touch with someone on the dev side.
Best,
Matt
-
Hey Matt,
Thanks for the question! As Lynn mentioned above, Rogerbot is our user agent, so that is your best option. We use a wide variety of IPs in our crawling that are constantly changing, so there really isn't any IP range that we can provide that will always work.
Cheers,
Ryan Watson
Business Development Associate | Moz -
Hi Matt,
Sorry maybe I misunderstood your question... I thought that was what you are after. How/What exactly is currently blocking the moz bot then?
-
Hi Lynn,
I was under the impression that it's really insecure to whitelist based on useragent.
Thanks,
Matt
-
Hi Matt,
The user agent is called rogerbot, you can see a reference to it here (towards the bottom of the page).
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
In Moz Campaigns, how are competitor domains tracked if they redirect their site?
Hello! One of our competitors (Company A) that we've tracked in Moz for a long time recently merged with another company (Company B) and redirected their whole site to Company B's site. Will our competitor tracking still work as-is? Or do we need to make an adjustment? I'm reluctant to delete Company A from our competitor tracking, because we will lose all of that data. But if all of the keywords are slowly going to drop off as Google starts showing Company B results only, it may be the only option. Any help is appreciated! Thanks!
Moz Bar | | PrimeFoodTeam0 -
The factors considered in the new domain authority algorithm? On-site factors we can use to compare with competitors? Is having an NA as a spam score a bad thing?
Does anyone know the factors considered in the new domain authority algorithm other than spam score and complex distributions of links based on quality and traffic? Does anyone know of on-site factors we can use to compare with competitors to try and improve DA? Is having an NA as a spam score a bad thing?
Moz Bar | | CQMarketing0 -
Site Crawl - MOz Pro
Hi There, When i look into my site crawl i have thousands of duplicate content issues. Now they are essentially product pages which are in multiple categories - however we have added the canonical tag so im confused as to why all of these are appearing as if there is an error, does the MOZ bot not take canonicals into account? Kind Regards Gemma
Moz Bar | | acsilver0 -
Can't download mozbar
Fine, I'm an idiot. But when i get that Chrome apps page with mozbar on it, there's nothing clickable (that I can see) that actually downloads the thing. I've gotten it before, but now I can't find it. Is it hiding. Why doesn't it just sit in my dock? Any ideas. -W
Moz Bar | | wrconard0 -
Keyword Difficulty Not Working (using it for AU)
The Keyword Difficulty is not working for AU. Can you get AU KWs to work? Any tips on us getting it to work? We've: deleted KWs and started over. logged out & logged back in. tried from multiple computers. waited hours. Thanks!
Moz Bar | | WME0 -
Moz Conversion Tracking
Is there a place here on Moz where goals and conversions can be set up or viewed? If the latter, does Moz just take the data from Analytics? Any information on this would be appreciated. Thanks,
Moz Bar | | xvpn9020 -
Can we export branded reports from Moz Analytics Beta yet?
Hey guys, Just looking around the new Moz-alytics (droooool) and it is superb, but are we able to export and build reports from it yet? Or is this something that will be in the final release? Apologies if this has already been asked. Regards! Joe Sturgess
Moz Bar | | Sturge
Twitter: @Sturge871 -
Moz.com Report a Problem or Provide Feedback
Two things. First, I could not find exactly where to report an issue or provide feedback about the website. I don't need to contact about Moz Analytics or any other products. I just want to provide feedback about the Moz Blog. I think it would be nice to be able to report an issue or provide feedback to "Roger" and have that item sent to the appropriate department for review. A lot of websites tend to use "webmaster@example.com" for this, but anything would work. My suggestion is to offer a feedback form on the Contact Moz page. Second, the issue I wanted to report has to do with blog comments. I left a comment early this morning and, with me being on Central Time and the timestamp for comments using Seattle local time, I was surprised to see that my comment had been posted "2 hours ago" immediately after I clicked "Submit." I presume this text is dynamic and that, in Seattle, you see "seconds ago" or something but, being in Wisconsin, I see "2 hours ago." This is confusing mainly because I have no idea how long ago other comments may have been posted. P.S. There isn't a question category for the Moz Blogs so I am choosing Moz - Other Research Tools. I view the blogs as a Product Moz provides so maybe adding "Moz - Blogs" to the Moz Product Help list of categories would be appropriate.
Moz Bar | | GeorgeAndrews0