Server blocking crawl bot due to DOS protection and MOZ Help team not responding
-
First of all has anyone else not received a response from the help team, ive sent 4 emails the oldest one is a month old, and one of our most used features on moz on demand crawl to find broken links doesnt work and its really frustrating to not get a response, when we're paying so much a month for a feature that doesnt work.
Ok rant over now onto the actual issue, on our crawls we're just getting 429 errors because our server has a DOS protection and is blocking MOZ's robot, im sure it will be as easy as whitelisting the robots IP, but i cant get a response from MOZ with the IP.
Cheers, Fergus
-
Hi dave thanks for your response ill let our server provider the user agent.
I was contacting you using the contact form, putting in my email which is the same as the one used to log into moz, but not the email that was used when creating the account, which i think might've been the issue.
-
Hi Dougal!
We don't have any record of support requests coming from the email associated with your Moz Pro account. Can you let us know how you are reaching out (contact form or emailing us directly at help@moz.com)?
Unfortunately, we do not use a static IP address or range of IP addresses, as we have designed our crawler to have a dynamic approach. This means we use thousands of dynamic IP addresses which will change each time we run a crawl. This approach gives us the best dynamic view of the web, but it can make us incompatible with some servers or hosting providers. The best option I'd be able to suggest would be to identify our crawler by User-agent: rogerbot
You can read more about rogerbot in our guide.
Look forward to hearing back!
-
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Can Moz add an alert to email us when a competitor's site gets a new backlink?
This would be a very useful feature, and other sites are doing this, including Ahrefs.
Feature Requests | | rabbit5190 -
Why Moz Update has 48 days this time?
Hi There! We have been Monitoring our DA in Moz.com, from past 6 Months and we have observed that every Moz update happens between 25 to 30 days. Why is the next update has been scheduled for 48 days of time? Is there any specific reason for this? Awaiting your response Thanks Malik Zakaria
Feature Requests | | mzakaria0 -
One of my Moz Campaigns was accidentally deleted. Any tips on getting it back?
I had a campaign setup with all of my keywords meticulously labeled and branded. Then by mistake, it was deleted. Is there any way I can restore/get the data back for an accidentally deleted campaign?
Feature Requests | | midcenturybliss0 -
Does moz offer a site auditor tool to imbed on your website?
similar service as http://mysiteauditor.com. just want to embed a tool on our website that allows the visitor to enter their url and have a report emailed to them.
Feature Requests | | WebMarkets1 -
Moz Crawler failing with https redirect?
Is there a way to get the Moz Crawl Test to work with HTTPS? I just got back this error: 902 : Network errors prevented crawler from contacting server for page. Site is set up with a standard 301 to redirect http to https - or at least I certainly hope it is! Rex Swain's HTTP Header Checker took shows a standard 301. Anyone else experiencing this error? btw - this is both a specific question and an opportunity for open discussion... Thanks!
Feature Requests | | seo_plus0 -
Suggestion to Improve Moz's Link Data
Hello All. The recent Index update (29th January) seems to have produced quite a few shocks to Moz Pro users. Index updates always cause panic and joy every time they are released. However, I feel this is a big improvement that could be made. In this last index, the DA for my site has remained the same. I was expecting a rise, simply because I have been doing some link building since October and was expecting the results to start showing around this time. However, the link metrics for my site looked worse this month than ever before. The index clearly didn't crawl sites and pages that it has crawled the last couple of indexes, and I noticed a few links disappeared from the metrics altogether, links that I know still exist. So I have a suggestion... If Moz has collected link data in previous indexes, can it not preserve that data rather than starting afresh with every new index. Regular checks could be conducted on existing link data to identify expired or broken links, but to disregard them and start anew with every index seems a little odd. That way, Moz would have much more accurate and comprehensive link data which would help to avoid the DA inaccuracy, and provide users with a better measure of how their site is performing against the rest of the web. This may be naive because I do not know the technical side to index updates. Any thoughts, advice, suggestions etc would be appreciated.
Feature Requests | | AHC_SEO0 -
Moz Local UK?
Moz Local discussions recently said the UK Moz Local will launch late Spring. As it's now Summer, I was just wondering if there's an updated date for Moz Local in the UK?
Feature Requests | | swankuk0 -
Is there a way to add custom dashboards into Moz's "Custom Reporting"?
I have dashboards set up in Google Analytics that track conversions and year over year traffic data and just wanted to see if their was a way to add those extra metrics Moz's Custom Report? Any help or suggestions would be much appreciated!
Feature Requests | | Gruenagency0