Given that I am currently using a bot sniffer...How can I identify the MOZ bot in order to whitelist it?
-
MOZ is currently blocked from crawling my sites because I use a bot sniffer.
Does anyone know how I can properly identify the MOZ bot in order to whitelist it?
MOZ is using Amazon web services and thus employs thousands of dynamic IPs to crawl.
-
Hi Ryan,
We only block by specific IPs because anyone can spoof a user agent. While i honestly appreciate your effort, could you please put me in touch with someone on the dev side.
Best,
Matt
-
Hey Matt,
Thanks for the question! As Lynn mentioned above, Rogerbot is our user agent, so that is your best option. We use a wide variety of IPs in our crawling that are constantly changing, so there really isn't any IP range that we can provide that will always work.
Cheers,
Ryan Watson
Business Development Associate | Moz -
Hi Matt,
Sorry maybe I misunderstood your question... I thought that was what you are after. How/What exactly is currently blocking the moz bot then?
-
Hi Lynn,
I was under the impression that it's really insecure to whitelist based on useragent.
Thanks,
Matt
-
Hi Matt,
The user agent is called rogerbot, you can see a reference to it here (towards the bottom of the page).
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
I bought a domain name ez1.in and it has high MOZ spam score. Althought i
I bought a domain name https://ez1.in and it has a high MOZ spam score. Although it is because of the previous webmaster who used this domain as a URL shortening website. But now I am using it as a service delivery website. I wanted to know once a domain is deleted and ready to resell MOZ doesn't update its Spam score? Or it has periodic updates that are scheduled? How does the whole process work?
Moz Bar | | vadir9690 -
Moz not updating the spam score metrics
Hi Experts, I have done everything to come over the following metrics flagged as spam on my website by Moz, few months ago. But, Moz has not updated the spam score yet. ✓Low MozTrust or MozRank Score - improved from 2 to 4.5
Moz Bar | | jamesh.rich01
✓Large Site with Few Links - My website have more than 6K backlinks
✓Small Proportion of Branded Links - My website have a good amount of branded backlinks
✓Thin Content - Every webpage on website has more than 500 words content
✓External Links in Navigation - There is no external link in navigation other than social media links
✓No Contact Info - The proper address has alreay been placed on website footer
✓Low Number of Pages Found - I am wondering if there are any standard score or number of links to reach to remove these flag?
Also, please suggest some ways that will help me improve moz spam score at faster rate. Thanks for your help in advance!"0 -
Why there is a big gap between MOZ and Google Analytics Keyword Ranking for my website?
Hello everyone, I've just started a SEO project and I'm very new in the field. Well, I tried to select the most interesting Keywords for my website. When I checked out what the current ranking for each one was, I noticed that between Google and MOZ, figures are totally different. For example, for the word "channel manager": on Google Analytics: #2 on MOZ: not in the top 50 I know that for Google Analytics, these numbers are average (12 months). But it cannot explain such a huge gap. Do you have an explanation for that? And also does that mean that I can't trust Google (really?). Because I also did some analysis with Google figures: Monthly searches, Competition... Thanks for you help! Happy Christmas, Floriane.
Moz Bar | | Frontdesk.Anywhere1 -
Moz Crawl Test says pages have no internal links
Greetings, I am working on a website, https://www.nasscoinc.com, and ran a Moz Crawl Test on it. According to the crawl test, only 2 of the website's hundreds of pages are receiving internal links. When I run a similar test on the site using Screaming Frog, I see that most of the pages have at least one internal link. I'm wondering if anyone has seen this before with the crawl test; and there is a way to get the crawl test to see the internal links? Thanks!
Moz Bar | | TopFloor0 -
Why does the Moz Tool Bar show code as HTML text for my site?
When I run my site in the Moz Tool bar, all of the page elements are read correctly except for HTML text. Sample page: http://www.lifeionizers.com/blog/alkaline-water/electrolyzed-reduced-water Instead of the text on that page, the tool shows Javascript code: /* With a very high character count for text (14,247).
Moz Bar | | karasd0 -
How can I find the old ERRORS and WARNINGS report in the NEW Moz design?
I'm looking for a complete list of errors and bugs that need to be fixed within a website. I used to use the MAIN tool (at least it seemed it was the most popular) but now that its just MOZ.com I can't seem to find that great report. It had data such as: 1. List of pages with Title Tags too long 2. List of pages with Description Tags too long 3. List of RED errors and YELLOW warnings, BLUE somethings... etc... Ring a bell? I LOVED this report, where can I find this data? Thanks! Derek
Moz Bar | | DerekM42420 -
Moz Toolbar Make My Browser Slower Drastically!
Hi, I really like Moz toolbar but it's totally make my browser (Firefox 26) slower (open new tab, new site, close / open the browser, etc.) What can I do to make it works faster With Moz toolbar? Thanks
Moz Bar | | JonsonSwartz0