Does the Moz crawler have a static ip address?
-
We block AWS from crawling our site. Does the moz crawler use a static ip address that we could allow? I'm currently not able to add a campaign because Moz can't connect to our site.
-
James
I currently use Sitelock which disallows unwanted bots to crawl the site. The MOZ is unable to crawl however we can input a white list of ip addresses comming from MOZ. How are you guys going around this issue?
Raul
-
Hi Dustin,
Unfortunately we do not use a static IP address as we have designed our crawler to have a location agnostic approach, this means we use thousands and thousands of IP addresses which will change each time we run a crawl. This approach gives us the best dynamic view of the web and in turn your sites.
We are moving more and more away from AWS but at this time we still use AWS to crawl certain portions.
Regards - James - Moz Help Team
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved Moz tried to charge our credit card
Hello, We noticed that MOZ tried to charge our credit card, while we are on Trial period until today. We decided to cancel the subscription (until our budget grows and come back). The tool is great, but it currently is too expensive for our business. We enjoyed the trial period and will surely come back when our business can afford it!! Thanks!
Getting Started | | intenseed0 -
Changing the Moz Crawl Date
Hello, I am wondering where I can change the date of Crawl by Moz. I would like to change this crawl period from one week to 2 or even 3 weeks for Moz to crawl my website. Hope to hear from anyone soon. Kind regards, Koen.
Getting Started | | Koenniiee1 -
Moz can't crawl my site.
Moz cannot carry out the site crawl on my online shop. Not really sure what the issue is, it has no problem getting onto my site when you use www. before the address, but it needs to be able to access bluerinsevintage.co.uk Stuck as what to do, we are a shopify store. Anyone else had this problem, or know what i need to change so they can crawl the site? thjis is the page they are getting when trying to get on bluerinsevintage.co.uk but if they use www.bluerinsevintage.co.uk the site comes up. Adam
Getting Started | | bluerinsevintage0 -
Setting up Moz Pro campaign for a subfolder
Hi, I'm just setting up my first campaign and would like some advice please. I have a website and also within it a a number of pages in a sub folder. These are technically a different business to the main website and I would like to track them separately in Moz so they can have their own keyword lists and competitors etc. How do I do this? Do I set up two separate campaigns www.site.com
Getting Started | | craigramsay
www.site.com/subfolder I understand the first one might still report on the subfolder but I guess I could just ignore this. Thanks0 -
I haven't used Moz and you've been billing me. Please refund thanks
I signed on for a free trial and found out today that you've billed me in June and July. Check my history as this is only the second time i've logged in and it's just to request you refund.
Getting Started | | Completebanker0 -
Duplicate Content after Moz Site Audit
Hello folks, So I signed up for the trial version of the Moz tool and ran an initial site audit. One of the site audit results is confusing me.
Getting Started | | jjimen03
It reports that there are two pages with duplicate content ( Each page has a duplicate page with duplicate content in it).
When I take a look at what those pages are, here is what I see: mysite.com/Contact-Us.html
mysite.com/contact-us.html
( The difference in the above is the Contact and Us, the first letters are capitalized on one of the URLS) mysite.com/index.html
mysite.com Now I am confused because for one thing, I don't have 2 Contact Us html files uploaded on my hosting server.
Why is Moz seeing 2 Contact Us pages? How to remove one? Regarding my home page, why is it flagging the same page as two different pages? How to remove of them?0 -
When does Moz update campaign data with new timeframe ?
Hi, I joined Moz community on last week and discovered an amazing tool. I set up my first campaign and I am getting information for a timeframe that's going from 7 to 13 of March. I believe that new data for 14 to 20 of March should be available but I didn't get any update. So, when is Moz supposed to update campaign data with fresh information ? Thanks in advance for such a dumb question. Sébastien
Getting Started | | lecercledesgourmets0 -
Changes to Moz
I used to think Moz was rich and full but man, there is so Much new stuff! I love it! I still need to explore everything. Does anybody know if its going to be an option for our clients to log in and see just their account? are changes in the works for reports we can pull and send to clients? thank you!! Matthew
Getting Started | | Mrupp441