What is the IP address of the MOZ crawlbot?
-
Our preproduction site is restricted to a specific IP range.
Prelaunch I'd like to use MOZ to check the site but this obviously isn't currently possible. Is there an IP range I can whitelist ?
-
Hi,
Moz is hosted on Amazon. See this sample log entry from today:
54.146.235.41 - - [17/Sep/2017:09:48:13 +0200] "GET /best-deals.html/page/12/ HTTP/1.0" 200 15803 "-" "rogerbot/1.2 (https://moz.com/help/guides/moz-procedures/what-is-rogerbot, rogerbot-crawler+aardwolf-production-crawler-97@moz.com)"[XF 54.146.235.41]
That IP is part of Amazon's ASN.
whois -h whois.radb.net -- '-i origin AS16509' | grep ^route
You can either use something like mod_authz to allow the domain amazonaws.com to connect or you can get each IP from AS16509 and allow that.
Hope it helps.
Regards
Chris
-
Just to expand on this, I found the following quote from a Moz member of staff:
"I wish I could give you IP addresses, but they change all the time since we host Roger in the cloud. There's not even a reliable range of IPs to give you. You can totally whitelist the useragent rogerbot, but that's the only reliable information about the crawler you can go off of. I hope that helps but let me know if there's any other solution you can think of. Thank you! "
From a previous question: https://moz.com/community/q/is-there-a-whitelist-of-the-rogerbot-ip-addresses
-
Unfortunately this is all I can find: https://moz.com/help/guides/moz-procedures/what-is-rogerbot with no IP range shown.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
MOZ flagging urls as longer than 75 characters when they aren't
As an example: https://www.abthermal.com/3m-70-70hdt-self-fusing-silicone-rubber-electrical-tape.html Moz has flagged this as URL too long... but guideline is that happens at 75 characters or more? I count 55..?? or does the 75 limit have to include the domain? Thanks, Adrian
Getting Started | | abtechgroup0 -
MOZ custom report is spamming my inbox
Hello, There seems to be a bug regarding MOZ's customized report. I set it up as a weekly report but i received up to 3 emails (4-5 hours interval) with incomplete data. Kindly fix. I'm using gmail. Thanks!
Getting Started | | leecourt0 -
New to MOZ, can't create a campaign.
I just started the free trial today, but I can't setup a campaign. Everywhere I go (http://analytics.moz.com/pro/home, http://analytics.moz.com/manage-campaigns), all I see is: Oops! Try refreshing the page, if that doesn't work, please click here to contact our help team. Is something broken?
Getting Started | | jcsilkey0 -
Moz Analytics - Custom Report Question
Hello Moz! I haven't been here since the days of SEOMoz, but it's great to be back and i'm really pleased to see lot of shiny new tools at my disposal, but I do have a question in regards to functionality. If I have, for example, 15 clients in my dashboard and would like to run the same report for all of them. Assuming that I just finished creating a custom report for my first client, how can I duplicate this report without having to re-create this report 15 times? Additionally, while I am here. I have noticed that when I add a campaign, the last screen never finishes loading and the window seems to freeze. A quick refresh fixes this, but I thought i'd flag it 🙂
Getting Started | | Paul_Tovey0 -
New to MOZ and working with Web Mentions. Can I use operators?
Our name is HostDime but often put as Host Dime (2 words) by news sources and other sites. How do I set up my brand mention so I only get a notice when both words appear, in order, together. I don't want "That host is a dime" and such. Can I use a +Host +Dime?"Host Dime"? Do these operators work in MOZ?
Getting Started | | hostdime0 -
Trending Bugs in Moz Analytics
The FAQ’s We hope we can help! Below are the trending issues at the moment. If you don’t see your question addressed or need further help, send us a message at http://moz.com/help/contact. Our Help Team gumshoes will investigate your issue and respond shortly. Where did my Campaigns Go?
Getting Started | | Abe_Schmidt
Whenever your account is suspended, your campaigns are archived. The good news is that reviving archived accounts is really simple. Go to your Campaigns section: http://pro.moz.com/campaigns
At the top of the page there is a "Archived Campaigns" Tab, give it a click.
From here, you should easily be able to "activate" your campaigns. My Google Analytics profile won’t stay connected to my campaign and/or I am missing profiles in my GA Settings. Google goes through a process called Oauth when it comes to authorizing access of services that are linked to your Google account. Under any single Google account, there are about 20 tokens account wide. Those tokens are used to provide access for a variety of services from Gmail to apps on your phone. Once you hit the limit, which is 20 for most users, the system automatically revokes the oldest token to provide a new one. I'm not certain if this is causing the issue on your account, but it is a great place to start troubleshooting. You may be able to correct the issue by manually revoking your tokens to make room for new ones on your account and then reconnecting the account to Moz. Here are the instructions on how to do that: Follow this link https://accounts.google.com/b/0/IssuedAuthSubTokens. This page displays the current OAuth tokens you are using. Once you reach the page, simply press the revoke button (illustrated on this screenshot: http://screencast.com/t/vjh3KrjRRIe) for services that you are not using right now. Once you are done with, that simply go back to your campaign settings, disconnect your GA profile and reconnect. The below process may also fix this issue for you. Head to your campaign settings page on your overview page. Disconnect your Google Analytics connection. Go back to your settings page and click on "connect account." Please make sure you log into the correct GA account. 🙂 Hurray! This should let you grab the most current traffic data! Oops! try refreshing page! I can’t access any of my Campaign data.
This issue is normally machine specific and can be a bit complex. An individual forum has been created to address this: https://seomoz.zendesk.com/entries/28203486-Oops-Try-Refreshing-the-Page-Error-showing-on-all-pages- Unable to retrieve historical ranking CSVs. Some users did not receive their requested Historical Rankings CSVs. This has mostly been affected by a change or update to your competitors after a campaign has been setup for a while. Please send your request to retrieve this data with http://moz.com/help/contact.8 -
MOZ Starter Crawl not happeneing
Hi I added a new site 48hours + ago and the starter crawler has not even begun collecting data. Any help would be appreciated. cheers Isaac
Getting Started | | sodafizz0