Server blocking crawl bot due to DOS protection and MOZ Help team not responding
-
First of all has anyone else not received a response from the help team, ive sent 4 emails the oldest one is a month old, and one of our most used features on moz on demand crawl to find broken links doesnt work and its really frustrating to not get a response, when we're paying so much a month for a feature that doesnt work.
Ok rant over now onto the actual issue, on our crawls we're just getting 429 errors because our server has a DOS protection and is blocking MOZ's robot, im sure it will be as easy as whitelisting the robots IP, but i cant get a response from MOZ with the IP.
Cheers, Fergus
-
Hi dave thanks for your response ill let our server provider the user agent.
I was contacting you using the contact form, putting in my email which is the same as the one used to log into moz, but not the email that was used when creating the account, which i think might've been the issue.
-
Hi Dougal!
We don't have any record of support requests coming from the email associated with your Moz Pro account. Can you let us know how you are reaching out (contact form or emailing us directly at help@moz.com)?
Unfortunately, we do not use a static IP address or range of IP addresses, as we have designed our crawler to have a dynamic approach. This means we use thousands of dynamic IP addresses which will change each time we run a crawl. This approach gives us the best dynamic view of the web, but it can make us incompatible with some servers or hosting providers. The best option I'd be able to suggest would be to identify our crawler by User-agent: rogerbot
You can read more about rogerbot in our guide.
Look forward to hearing back!
-
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Can I connect my moz crawl to datastudio to list 404s in a table
Hello I currently export 404s and other 'critical' issues to a google sheet and publish them in a monthly report in data studio Is there a way to automate this process so that my monthly report is automatically populated with critical issues
Feature Requests | | Andrew-SEO0 -
Why my site's DA and Pa Not Show Accurate By MOZ Extension.
my site has some minor problem which about DA and PA that DA and PA do not show accurate some time my site is yts subtitle, please tell me something about it.
Feature Requests | | darkwebvampire0 -
Even canonical present in my web pages, still moz showing canonical issues.
Even canonical present in my web pages, still moz showing canonical issues. ex : rel="canonical" content="https://www.domain.com/page/">
Feature Requests | | prasad.nueve1 -
Access all crawl tests
How can I see all crawl tests ran in the history of the account? Also, can I get them sent to an email that isn't the primary one on the account? Please advise as I need this historical data ASAP.
Feature Requests | | Brafton-Marketing0 -
Does moz offer a site auditor tool to imbed on your website?
similar service as http://mysiteauditor.com. just want to embed a tool on our website that allows the visitor to enter their url and have a report emailed to them.
Feature Requests | | WebMarkets1 -
Discrepancy in "np" within in my Moz Report?
| Keyword |
Feature Requests | | jessential
| np - /google-structured-data-update/ | In my "New Rankings & Insights | Hill Web Creations" report, while "Google structured data update" moved up significantly, at the same time, "np - /google-structured-data-update/" moved down significantly. Any insights that would offer a deeper understanding of the discrepancy and how to pull both up? If this corresponds with Google Analytics, the "np" Acquisitions > Campaigns > Organic Keywords > "Organic Search Traffic" Report, how is Moz rendering is New Rankings & Insights?0 -
Suggestion to Improve Moz's Link Data
Hello All. The recent Index update (29th January) seems to have produced quite a few shocks to Moz Pro users. Index updates always cause panic and joy every time they are released. However, I feel this is a big improvement that could be made. In this last index, the DA for my site has remained the same. I was expecting a rise, simply because I have been doing some link building since October and was expecting the results to start showing around this time. However, the link metrics for my site looked worse this month than ever before. The index clearly didn't crawl sites and pages that it has crawled the last couple of indexes, and I noticed a few links disappeared from the metrics altogether, links that I know still exist. So I have a suggestion... If Moz has collected link data in previous indexes, can it not preserve that data rather than starting afresh with every new index. Regular checks could be conducted on existing link data to identify expired or broken links, but to disregard them and start anew with every index seems a little odd. That way, Moz would have much more accurate and comprehensive link data which would help to avoid the DA inaccuracy, and provide users with a better measure of how their site is performing against the rest of the web. This may be naive because I do not know the technical side to index updates. Any thoughts, advice, suggestions etc would be appreciated.
Feature Requests | | AHC_SEO0
