Given that I am currently using a bot sniffer...How can I identify the MOZ bot in order to whitelist it?
-
MOZ is currently blocked from crawling my sites because I use a bot sniffer.
Does anyone know how I can properly identify the MOZ bot in order to whitelist it?
MOZ is using Amazon web services and thus employs thousands of dynamic IPs to crawl.
-
Hi Ryan,
We only block by specific IPs because anyone can spoof a user agent. While i honestly appreciate your effort, could you please put me in touch with someone on the dev side.
Best,
Matt
-
Hey Matt,
Thanks for the question! As Lynn mentioned above, Rogerbot is our user agent, so that is your best option. We use a wide variety of IPs in our crawling that are constantly changing, so there really isn't any IP range that we can provide that will always work.
Cheers,
Ryan Watson
Business Development Associate | Moz -
Hi Matt,
Sorry maybe I misunderstood your question... I thought that was what you are after. How/What exactly is currently blocking the moz bot then?
-
Hi Lynn,
I was under the impression that it's really insecure to whitelist based on useragent.
Thanks,
Matt
-
Hi Matt,
The user agent is called rogerbot, you can see a reference to it here (towards the bottom of the page).
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
How do I pull "Mobile Rankings" in MOZ?
My client wants me to pull mobile-specific rankings through Moz's keyword explorer. Does anyone know if this is possible? Thanks!
Moz Bar | | TaylorAtVelox0 -
Moz is not showing traffic stats..;(
I have connected my analytics account in moz. But it is not showing my traffic stats.
Moz Bar | | daniyal_ahmed0 -
Confused by "Exact Keyword Used in Document Text at Least Once".
Hi, I am using the On-Page Grader to improve the SEO for certain keywords on certain pages. I have received the notification that the "Exact Keyword Used in Document Text at Least Once". Well from the looks of it I have already done this but I want to make sure that im checking the right thing. What does it mean when it says document text as I assumed it was text on the page but its not reading it as that. Any feedback would be appreciated
Moz Bar | | charlessimmons0 -
Moz's on-page grader
Hello, I am having an issue with Moz's on-page grader. Grading the page, http://www.babyklar.dk/tigerspring/26-ugers-springet.html for the keyword 'Tigerspring 26 uger' I am receiving the error message: 'Exact keyword is used in page title' - tagging it as a highly important but easy fix. But I only have the words "Tigerspring 26 uger" in the title, so how can this not grade as Exact keyword? Is there somthing wrong with the system? Or is it me? Thanks very much. Best regards
Moz Bar | | Babyklar
Martin0 -
Moz Local | Empty page "Categories"
Dear Moz, Another error, the following url loads an empty page https://moz.com/local/categories Please review Thanks!
Moz Bar | | Bio-RadAbs0 -
I have been unable to use the export button on any of the Moz pages.
Every time I click the export button on the upper right portion of the page, it says "preparing to export", but either nothing is exported or a blank document is downloaded. I was specifically working with the Fresh Web Explorer but have noticed this on all pages. Is anyone getting this export function to work?
Moz Bar | | Manseo0 -
Optimise your Pages in Moz Crawl - where do the keywords come from?
I am just going through my first Crawl stats from the MOZ analytics Under the pages to optimise section I have pages that I have optimised for my best keyword with an A grade that are showing as an F grade and suggesting a different keyword? Where is this keyword coming from? I am assuming that my page has been analysed and a better keyword has been recommended? Can anyone advise? Thanks Roger
Moz Bar | | rnperki0 -
I already have a campaign registered in moz, but it does not appear when I open Moz Analytics, as I proceed?
I received an email suggesting you upgrade to Moz Analytics, however to do the procedure my existing campaign stopped appearing and I can not access it, how should I proceed?I need back to Pro?
Moz Bar | | IBacana0