Does the Moz crawler have a static ip address?
-
We block AWS from crawling our site. Does the moz crawler use a static ip address that we could allow? I'm currently not able to add a campaign because Moz can't connect to our site.
-
James
I currently use Sitelock which disallows unwanted bots to crawl the site. The MOZ is unable to crawl however we can input a white list of ip addresses comming from MOZ. How are you guys going around this issue?
Raul
-
Hi Dustin,
Unfortunately we do not use a static IP address as we have designed our crawler to have a location agnostic approach, this means we use thousands and thousands of IP addresses which will change each time we run a crawl. This approach gives us the best dynamic view of the web and in turn your sites.
We are moving more and more away from AWS but at this time we still use AWS to crawl certain portions.
Regards - James - Moz Help Team
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Best use of Moz Pro
Hello, I want to ask what are the benefits of Moz Pro other than finding low competitive keywords? I want to know the best use of Moz Pro for betterment of my site (chicken grill recipe). I want the best possible result. Guide me. Thanks.
Getting Started | | maxcharles0 -
Moz only crawling one page of a campaign, please help
Today I set up a new campaign for a client, however the crawl has only found the home page and is saying that the URL is unavailable. The site is definitely live and the URL is correct. I have set up the campaign 3 times one with the full address (http://www.) one with www. and with just the domain name. All three of these have come page with one page crawled and "unavailable" above the URL. It is picking up the crawl issues on the page and showing domain authority but I don't know why it's not crawling other pages. Prior to setting up the campaign I did a site crawl and Moz found everything then, so I don't know why it isn't now. Please help. Thanks
Getting Started | | Wrapped0 -
Does MOZ pick up every issue in one crawl?
Hi, Does MOZ pick up every error/warning in one crawl? Or does it take numerous crawls? Many thanks Lee
Getting Started | | lbagley0 -
Canonical url does not seem to be recognised by Moz
Hey guys, forgive me... brand new user of Moz. Moz is telling me I have duplicate url's - a lot of them. Investigating I see that it is classing http://creativedigital.co.nz/artprints/lake-tekapo-church-of-the-good-shepherd?tag=lake as a duplicate of http://creativedigital.co.nz/artprints/lake-tekapo-church-of-the-good-shepherd even though there is a canonical tag in head as follows I'm not quite sure what I am doing wrong. Any advice would really be appreciated 🙂 Mike
Getting Started | | creative.digital0 -
New non-www. web address but the domain is the same
Hi Everyone, we're launching a new WP website that has a non-www. web address. Old address www.1to1therapy.ca, new address http://1to1therapy.ca. A re-direct has been created for the www. address. It appears that this is causing an issue for the Moz page crawler. It is currently only crawling 1 page. I will set up a new campaign. BUT As best practice should I set up all new google analytics on http://1to1therapy.ca? It appears that the analytics are functioning correctly, but I'm unsure if any issues may arise from the change.
Getting Started | | JayTurner0 -
Moz not reading Visit to my website
Hello , i have conencted moz to My new ecommerce website , MOZ is not reading any visits , although i can see the visit on google analytics and i have moz connected to My analytics as well, why i cant see the visits ? need your help please 🙂
Getting Started | | moeayyad0 -
When does Moz update campaign data with new timeframe ?
Hi, I joined Moz community on last week and discovered an amazing tool. I set up my first campaign and I am getting information for a timeframe that's going from 7 to 13 of March. I believe that new data for 14 to 20 of March should be available but I didn't get any update. So, when is Moz supposed to update campaign data with fresh information ? Thanks in advance for such a dumb question. Sébastien
Getting Started | | lecercledesgourmets0 -
MOZ cannot connect to GA
As I went thru the process of setting up my campaign, MOZ could not connect to my GA account. Any idea why?
Getting Started | | selectlocks0
