Does the Moz crawler have a static ip address?
-
We block AWS from crawling our site. Does the moz crawler use a static ip address that we could allow? I'm currently not able to add a campaign because Moz can't connect to our site.
-
James
I currently use Sitelock which disallows unwanted bots to crawl the site. The MOZ is unable to crawl however we can input a white list of ip addresses comming from MOZ. How are you guys going around this issue?
Raul
-
Hi Dustin,
Unfortunately we do not use a static IP address as we have designed our crawler to have a location agnostic approach, this means we use thousands and thousands of IP addresses which will change each time we run a crawl. This approach gives us the best dynamic view of the web and in turn your sites.
We are moving more and more away from AWS but at this time we still use AWS to crawl certain portions.
Regards - James - Moz Help Team
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
What is the best use for Moz tools specially keyword difficulty for startup ?
Hello, I'm so new in Moz and SEO world and i just started my website, a WordPress blog, I'm in a content creation period and i want to make it right from the beginning but I'm confused about how to use Moz tools in this period because i don't have content or traffic so no analytic as i think, so What is the best use of Moz tools in this period? About keyword difficulty tool i think this is the most tool i will use in the beginning, how i choose which keywords to use from my keywords list, in this time I'm depending on the on page SEO only, no backlinks no social engagements, which keywords to use to appear fast in search engines for a startup? less than "% difficulty " or between, I"m new in this word Please Moz and SEO experts give me a hand here. Note: I'm using Medium Moz pro plan.
Getting Started | | Romekio1 -
After fixing Crawl Errors, how long does it take to for Moz or Google to re-crawl a website?
Last night I found out through Moz that my robots.txt file was blocking any crawling of my website. I fixed the issue. Now do I just sit and wait?
Getting Started | | cmc-interactive0 -
MOZ custom report is spamming my inbox
Hello, There seems to be a bug regarding MOZ's customized report. I set it up as a weekly report but i received up to 3 emails (4-5 hours interval) with incomplete data. Kindly fix. I'm using gmail. Thanks!
Getting Started | | leecourt0 -
Is there a difference between Moz Pro and Moz Analytics?
I thought that Moz Analytics was now included with Moz Pro. Is this true? I have Moz Pro and I was using the beta version of Moz Analytics back in October. When I log into Moz Analytics, the latest data stops at October 27th and there is no data after that. Is that an indication of when my trial period ended? I have the basic Moz Pro, does that include Analytics portion? Thanks!
Getting Started | | Symmetri0 -
How to get moz to crawl a staging domain that is blocked by robots.txt
Is it possible to get Moz to do a crawl report on a domain blocked by robots.txt and actually display all errors instead of only one saying the domain was blocket in robots.txt? Anything i can add to robots.txt to make moz able to do the crawl report but still hinder google from crawling a staging domain?
Getting Started | | classifiedtech0 -
MOZ cannot connect to GA
As I went thru the process of setting up my campaign, MOZ could not connect to my GA account. Any idea why?
Getting Started | | selectlocks0 -
Where to find answers to really dumb questions about setting up Moz campaigns...
I had a Moz account earlier this year, let it drop for a few months, then decided it really was important to have one. So I'm back. But there is still something about it that I really find frustrating. I can't seem to find any answers to what seem to be basic questions. Maybe they are too simple, maybe they are just dumb questions, but I sure would appreciate it if somebody could lead me to another source of information. Maybe somebody has written a "Moz for Dummies" book? Here's an example: I'm setting up campaigns for my websites, and I get to the Brand and Mentions section. It tries to autofill the space using my campaign name, but that's not accurate. So I go look at the Help Hub for Brands and Mentions, and it gives an example using MOZ as the brand name. But not many sites have a three-letter domain name, do they?. One of my domains is EasyDigging.com (2 words) and the other is BestDryingRack.com (3 words). So I look and look, but can't find any examples of longer domain names. So I have no idea how to enter my Brand. Should it be the whole "EasyDigging.com" or should it just be "EasyDIgging" or should it be broke up into "Easy Digging"? This is just 1 example. I find these sort of unanswered questions almost every time I try something new. Is there a collection of examples anywhere? I really hope so. Surely there are others who learn best from examples, who hate having to guess based on slim or vague instructions. Keeping my fingers crossed that somebody can lead me to the goldmine of good examples. Thanks!
Getting Started | | GregB1230