Server blocking crawl bot due to DOS protection and MOZ Help team not responding
-
First of all has anyone else not received a response from the help team, ive sent 4 emails the oldest one is a month old, and one of our most used features on moz on demand crawl to find broken links doesnt work and its really frustrating to not get a response, when we're paying so much a month for a feature that doesnt work.
Ok rant over now onto the actual issue, on our crawls we're just getting 429 errors because our server has a DOS protection and is blocking MOZ's robot, im sure it will be as easy as whitelisting the robots IP, but i cant get a response from MOZ with the IP.
Cheers, Fergus
-
Hi dave thanks for your response ill let our server provider the user agent.
I was contacting you using the contact form, putting in my email which is the same as the one used to log into moz, but not the email that was used when creating the account, which i think might've been the issue.
-
Hi Dougal!
We don't have any record of support requests coming from the email associated with your Moz Pro account. Can you let us know how you are reaching out (contact form or emailing us directly at help@moz.com)?
Unfortunately, we do not use a static IP address or range of IP addresses, as we have designed our crawler to have a dynamic approach. This means we use thousands of dynamic IP addresses which will change each time we run a crawl. This approach gives us the best dynamic view of the web, but it can make us incompatible with some servers or hosting providers. The best option I'd be able to suggest would be to identify our crawler by User-agent: rogerbot
You can read more about rogerbot in our guide.
Look forward to hearing back!
-
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Is there a moz tool to optimize original advertorial content?
We are launching a new module that will involve paid advertorial along with unpaid articles. Does Moz have a tool that will help us with optimizing these articles for the English speaking Hong Kong market? We are not interested in optimizing for the US or other markets as people there would not be searching for the content we are producing so the optimization would not be very relevant. Example: https://hongkong.asiaxpat.com/other/263101/guide-to-buying-and-riding-a-motorcycle-in-hong-kong/
Feature Requests | | HKPaul0 -
Moz Keyword Explorer - Explore by Folder
When using Moz Keyword Explorer to search for my ranking keywords is there any way to see the ranking keywords for a directory or folder on a site? For example: if a blog is located at a subdomain, I can see all the ranking keywords for the blog by selecting subdomain and searching for https://blog.example.com. However, I would like to be able to search for all of a blog's ranking keywords if the blog URL is something like https://example.com/blog/ instead. If this is not feature, can I request its addition? Thank you!
Feature Requests | | LEAP_US_Marketing1 -
Can Moz add an alert to email us when a competitor's site gets a new backlink?
This would be a very useful feature, and other sites are doing this, including Ahrefs.
Feature Requests | | rabbit5190 -
One of my Moz Campaigns was accidentally deleted. Any tips on getting it back?
I had a campaign setup with all of my keywords meticulously labeled and branded. Then by mistake, it was deleted. Is there any way I can restore/get the data back for an accidentally deleted campaign?
Feature Requests | | midcenturybliss0 -
Hi Moz community! Why are the number of high priority issues (404s) significantly different between MoZ and Google search console?
Hi Moz community! So when i ran a site crawl to analyze page issues for a site that has been in our account for some time now, it only showed 10 high priority (404) issues...yet when i logged into wordpress and installed yoast premium and connected to google search console, around 900 404s showed up....(we have not blocked off any pages to be crawled) does anyone know a reason why this happens?
Feature Requests | | rooify0 -
Crawl diagnostic errors due to query string
I'm seeing a large amount of duplicate page titles, duplicate content, missing meta descriptions, etc. in my Crawl Diagnostics Report due to URLs' query strings. These pages already have canonical tags, but I know canonical tags aren't considered in MOZ's crawl diagnostic reports and therefore won't reduce the number of reported errors. Is there any way to configure MOZ to not consider query string variants as unique URLs? It's difficult to find a legitimate error among hundreds of these non-errors.
Feature Requests | | jmorehouse0 -
Competitor changed URL. What data do I lose if I update Moz settings?
One of my competitor's has changed their domain URL. I want to update this in the Moz campaign settings but I get a warning that all historical data will be lost if I do. Is that really true? I replaced one of my competitors with another for a week and didn't seem to lose historical data. Incidentally, could this be a feature request to allow more competitors to be tracked? eqEhEHz.jpg
Feature Requests | | justin-brock0 -
Can I add more then 3 competitors do my SEO moz pro account?
I have a client who will need more then the three competitors tracked(possibly up to 10) is there any way to do this with one campaign or will i need to start multiple campaigns to achieve this?
Feature Requests | | BBI_Brandboost8