Mozbot IP / reverse DNS
-
Hi,
due to security measures (which i imagine a lot of enterprise clients are starting to use now) we're very restrictive of automated traffic coming to our websites... however we're also blocking the mozbot.
Will Moz have a fixed IP address/range or reverseDNS look up approach that can be used in the future?
thanks!
-
thanks! Will you allow for reversDNS lookup?
similar to: https://support.google.com/webmasters/answer/80553?hl=en
-
Hello!
For our link crawler, you will want to make sure you are blocking "dotbot" specifically.
Unfortunately we do not use a static IP address or range of IP addresses or plan to do so in the future, as we have designed our crawler to have a dynamic approach. This means we use thousands of dynamic IP addresses which will change each time we run a crawl. This approach gives us the best dynamic view of the web, but it can make us incompatible with some servers or hosting providers.
The best option I'd be able to suggest would be to identify our crawler by User-agent: dotbot
I apologize for the inconvenience this causes!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Are there any plans for a Moz connector to Google Data Studio
Hello all, As title reads, are there any plans for a Moz connector to Google Data Studio to help automate reporting? I'm surprised this doesn't exist already because Data Studio is so heavily used. Thanks in advance. Simon
Feature Requests | | parkersj9 -
Are Monthly-Run custom reports supposed to compare against the previous month?
When I run monthly reports, it looks like keywords are down, when they are actually up compared to the previous month. Is there a way to get the monthly reports to show how many positions up or down a keyword is compared to the prior run report?
Feature Requests | | bizmarquee0 -
Duplicate Titles being shown for rel=prev / next paginated pages
Hello My duplicate titles report is full of paginated pages eg www.roger-bot.com/rogers-diary/sites-ive-crawled
Feature Requests | | Andrew-SEO
www.roger-bot.com/rogers-diary/sites-ive-crawled?p2
www.roger-bot.com/rogers-diary/sites-ive-crawled?p3
www.roger-bot.com/rogers-diary/sites-ive-crawled?p4
www.roger-bot.com/rogers-diary/sites-ive-crawled?p5
www.roger-bot.com/rogers-diary/sites-ive-crawled?p6 This would create 5 duplicate titles in the moz report Is there a quick way to filter these out?1 -
Are there no tools for evaluating/recommending internal links in Moz?
Everything I've seen using Moz has been great, but there's one thing I can't figure out how to do. All I want to see is some kind of overview or display of my site's internal link architecture, but there doesn't appear to be anything like that in any of the Moz tools? Am I missing it, or do they just not have anything for that?
Feature Requests | | A.S.0 -
Can you please add Dallas/Fort Worth Metroplex or at least Counties to local keyword search areas?
I would like to request that a "Dallas/Fort Worth Metroplex" option be added to the keyword search areas. As it stands, each city must be individually chosen, which is not only very time consuming, but also acts as an insurmountable multiplier for the keywords used in our campaigns. Most businesses in DFW serve the entire Metroplex, which consists of around 200 cities. Even the core largest number well over 50. Almost all of these cities are within about 50 miles of each other as well. Asking the majority of businesses to only focus their SEO monitoring efforts on a few cities in the Metroplex would be like asking a Hyper Wal-Mart to only monitor about 10% of their inventory at most, and more likely 1-5%. Alternately, if you could instead have County choices for DFW, that would help a lot. The counties of DFW are: Collin County
Feature Requests | | sbatx
Dallas County
Denton County
Ellis County
Hood County
Hunt County
Johnson County
Kaufman County
Parker County
Rockwall County
Somervell County
Tarrant County
Wise County The three in bold are typically the most important for businesses in the Metroplex, though each of the outlying counties listed contain dozens of cities as well, each with their own particular specialties, focuses, and demographics.0 -
Migrate campaign from when site changes from http:// to https://
We moved from our site from http:// to https://, redirecting all traffic to the new https connection. However, in our campaign all scores have dropped (only 1 page crawled). Is there something we can do to migratie the data, or update the existing campaign to reflect this minor change to our existing site?
Feature Requests | | BentoPres0 -
Feature Request: connecting to Adobe Analytics
We're moving away from Google Analytics and setting up Adobe Analytics (previous Omniture).
Feature Requests | | KBC
It would be nice to incorporate this data, so I have a complete tool again...2
