Moz Q&A is closed.
After more than 13 years, and tens of thousands of questions, Moz Q&A closed on 12th December 2024. Whilst we’re not completely removing the content - many posts will still be possible to view - we have locked both new posts and new replies. More details here.
SEO Web Crawler IP addresses
-
What are the IP addresses for the SEO Web Crawler?
There is a firewall on my clients website before it goes live, I would like to crawl the site before it goes live, but need to provide the web crawlers IP addreses.
Thank you for your time
-
Hi Jason,
This is Megan from the SEOmoz Help Team. Unfortunately, since we crawl from the cloud, RogerBot's IP address is changing all of the time so we cannot specify a particular IP address. Also, we do need the site to be live before we can crawl it, but you could remove the firewall and block all other bots except rogerbot so it won't get indexed anywhere else before it's ready.
I hope this helps! Please let me know if you have any other questions.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
What Moz reports would you suggest running when pitching SEO services to a client?
What do you think the best Moz reports are when presenting SEO services to a client? I need to share reports that show where the opportunity is and where we will be prioritizing our effort. I'd like to hear what you would suggest given your experience presenting SEO to clients. Thanks in advance for your help!
Moz Pro | | mrupert1 -
What are the restrictions/limitations to running SEO/Adwords in these countries?
What are the limitations or restrictions to running SEO/Adwords campaigns in countries such as China, South Korea, Japan, Brazil, Portugal, Spain, and Mexico?
Moz Pro | | ThomasCenterInc0 -
Which kind of backlink is best for SEO
After complete the jobs of keywords, it may worth to spend more time for building up more backlinks to enhance the SEO, so do you have any suggestion about which kind of backlink is best to build? as I know now, the backlinks are classified to be: 1. profile article, 2. book mark, 3. signature, 4. wiki article, 5. blog comment etc. I am very new for SEO, so it's welcome to give me any suggestion or comment for my opinion as above. Thanks a lot! -John.
Moz Pro | | Steplead0 -
Rel=canonical SEO Ultimate plug in
I like SEO ultimate and use the rel=canonicalizer has anyone come into problems with it... ps I still cant get my head around canonical tags!
Moz Pro | | Agentmorris0 -
What do the dates refer to in seo moz reports
question is in the title - new trainee asked me and couldn't actually answer!
Moz Pro | | Highlandgael0 -
Localize Web App
Is there a way to "localize the web app"? In other words, get ranking results based on a location? I pecked around the forum and documentation but couldn't find anything. Any plans to move in this direction? I'm getting wildly different results based on browser location settings. Any thoughts are welcome.
Moz Pro | | Gyi0 -
Where is the best SEO Glossary of Terms?
Where do you feel the best existing Glossary of SEO / SEM Terms explained currently resides. (and is there a better way to ask this question?) 🙂
Moz Pro | | iansears0 -
How can I view the "Ultimate Advanced SEO Bundle" online after purchasing it?
I purchased the Ultimate Advanced SEO Bundle DVD set and I understand that I can also watch it online. Where do I have to go to view it? MC
Moz Pro | | deuce1s0