Given that I am currently using a bot sniffer...How can I identify the MOZ bot in order to whitelist it?
-
MOZ is currently blocked from crawling my sites because I use a bot sniffer.
Does anyone know how I can properly identify the MOZ bot in order to whitelist it?
MOZ is using Amazon web services and thus employs thousands of dynamic IPs to crawl.
-
Hi Ryan,
We only block by specific IPs because anyone can spoof a user agent. While i honestly appreciate your effort, could you please put me in touch with someone on the dev side.
Best,
Matt
-
Hey Matt,
Thanks for the question! As Lynn mentioned above, Rogerbot is our user agent, so that is your best option. We use a wide variety of IPs in our crawling that are constantly changing, so there really isn't any IP range that we can provide that will always work.
Cheers,
Ryan Watson
Business Development Associate | Moz -
Hi Matt,
Sorry maybe I misunderstood your question... I thought that was what you are after. How/What exactly is currently blocking the moz bot then?
-
Hi Lynn,
I was under the impression that it's really insecure to whitelist based on useragent.
Thanks,
Matt
-
Hi Matt,
The user agent is called rogerbot, you can see a reference to it here (towards the bottom of the page).
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
I have too many tittle tag issue for my site on moz site crawl error
I have too many tittle tag issue in site crawl error but when I checked manually for the error there is no title in source code. Please Help me to understand
Moz Bar | | Nileshaggarwal0 -
How can a page have high Google/ organic traffic but show no ranking keywords in Moz?
We have a page on our website with a higher than average number of pageviews, 85% of which came from Google organic search. When I research this page by entering the URL into the "exact page" keyword research tool, Moz says it has no ranking keywords. How can a page be earning organic traffic without ranking for any keywords?
Moz Bar | | baystatemarketing0 -
The Page Optimization tool keeps asking for several changes that are already in place! How can I get it to recognize them?
Hi there...the Page Optimization tool shows a 71 score for one of my pages, but the most critical needs it noted have already been in there for some time. What's the deal with this? Thanks...
Moz Bar | | adirondack0 -
Duplicate page found with MOZ crawl test?
When I crawl my website www.radiantguard.com, the crawl test comes back with what appears to be a duplicate of my home page: http://www.radiantguard.com and http://www.radiantguard.com/ Does the crawler indeed see two different pages and therefore, are my search engine rankings potentially affected, AND is this because of how my rel canonical is set up?
Moz Bar | | rhondafranklin0 -
Keyword used 2389 times in page
in the "on page grader" tool I get that the keyword appears 2389 times. I'ave searched for it in the developer console, thinking it might be due to invalid HTML - but the number it's appearance is no near to 2389. Can any one help me figure out why is this so? the page is http://naamanewman.co.il/photosGalleryID.aspx?id=34
Moz Bar | | digitalalchemy
keyword "שמלות כלה נפוחות" (hebrew) QDQW4xw.png0 -
Using Moz to find blogger with good PR.
Hi, My manager has recently informed me that you can use Moz in order to find blogger by category and their page rank. Is this possible? The reason for this is because we are looking for blogger with a good page rank and who are relevant to our sector, which is days out, outdoor activities, zipwires, adventure etc. We then want to contact them to see if we can invite them to write about our Tree Top Adventure and zip trekking activities. Any help would be much appreciated.
Moz Bar | | GoApe_20140 -
Are MOZ Analytics dashboards available for other timeframes than the week just gone?
Hi Guys, We're wondering if anyone knows if there is a way to get moz analytics dashboard reports for timeframes other than just the last week? When we view the dashboard report, under the heading there is a 'timeframe' dropdown, however it only ever shows us the previous week as an option. Would be great if anyone knows if this is available now / soon? Cheers, Camille@Trilogy
Moz Bar | | Trilogy1