Mozbot IP / reverse DNS
-
Hi,
due to security measures (which i imagine a lot of enterprise clients are starting to use now) we're very restrictive of automated traffic coming to our websites... however we're also blocking the mozbot.
Will Moz have a fixed IP address/range or reverseDNS look up approach that can be used in the future?
thanks!
-
thanks! Will you allow for reversDNS lookup?
similar to: https://support.google.com/webmasters/answer/80553?hl=en
-
Hello!
For our link crawler, you will want to make sure you are blocking "dotbot" specifically.
Unfortunately we do not use a static IP address or range of IP addresses or plan to do so in the future, as we have designed our crawler to have a dynamic approach. This means we use thousands of dynamic IP addresses which will change each time we run a crawl. This approach gives us the best dynamic view of the web, but it can make us incompatible with some servers or hosting providers.
The best option I'd be able to suggest would be to identify our crawler by User-agent: dotbot
I apologize for the inconvenience this causes!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved Matomo Data Integration
As GA4 is not easily usable for all clients in the EU, it would be great if you could offer a Matomo integration. Matomo has recently been more and more popular and is used by a lot of companies, that are required to adhere to EU standards in data privacy.
Feature Requests | | datenwerk0 -
Moz Link Explorer for Google Data Studio
I want to put Moz's link explorer into my data studio report. (Including Domain Authority, Linking Domains, Inbound Links, and Ranking Keywords). How can I do this?
Feature Requests | | Kaili0 -
Can the login page be updated (the tab order)?
When utilizing certain password manages, the tab order on the login page is set in such a way that the username fills in and then where the password should go is the Create an Account link. Thus, the password is not filled in and the user is brought to the Create an Account page.
Feature Requests | | mike.brodeur0 -
Why my site's DA and Pa Not Show Accurate By MOZ Extension.
my site has some minor problem which about DA and PA that DA and PA do not show accurate some time my site is yts subtitle, please tell me something about it.
Feature Requests | | darkwebvampire0 -
Duplicate Titles being shown for rel=prev / next paginated pages
Hello My duplicate titles report is full of paginated pages eg www.roger-bot.com/rogers-diary/sites-ive-crawled
Feature Requests | | Andrew-SEO
www.roger-bot.com/rogers-diary/sites-ive-crawled?p2
www.roger-bot.com/rogers-diary/sites-ive-crawled?p3
www.roger-bot.com/rogers-diary/sites-ive-crawled?p4
www.roger-bot.com/rogers-diary/sites-ive-crawled?p5
www.roger-bot.com/rogers-diary/sites-ive-crawled?p6 This would create 5 duplicate titles in the moz report Is there a quick way to filter these out?1 -
Does/could the MpzBar highlight your website in the SERPs?
Is anyone aware of a setting in the MozBar which would highlight your website within SERPs? Or, even more exciting, display a number on the bar when looking at a SERP, showing your best current position for that query (in real time)? If not, it'd be interesting to know your thoughts on the idea? Great for quick checks and references or would it discourage people from staying vigilant in the SERPs and keeping an eye on the competition? (Note: we do have MOZ Pro and are aware that it does something similar. I'm thinking more for a quick check of those difficult targets where you're not hitting the first couple of pages).
Feature Requests | | MSGroup0 -
Can I add more then 3 competitors do my SEO moz pro account?
I have a client who will need more then the three competitors tracked(possibly up to 10) is there any way to do this with one campaign or will i need to start multiple campaigns to achieve this?
Feature Requests | | BBI_Brandboost8
