Unsolved 503 Service Unavailable (temporary?) Rogerbot takes a break
-
A lot of my Moz duties seem to be setting hundreds of issues to ignore because my site was getting crawled while under maintenance. Why can't Rogerbot take a break after running into a few of these and then try again later? Is there an official code for Temporary Service Unavailability that can smart bots pause crawls so that they are not wasting compute, bandwidth, crawl budget and my time?
-
@awilliams_kingston said in 503 Service Unavailable (temporary?) Rogerbot takes a break:
A lot of my Moz duties seem to be setting hundreds of issues to ignore because my site was getting crawled while under maintenance. Why can't Rogerbot take a break after running into a few of these and then try again later? Is there an official code for Temporary Service Unavailability that can smart bots pause crawls so that they are not wasting compute, bandwidth, crawl budget and my time?
You can use HTTP status code 503 for Temporary Service Unavailability to signal bots to pause crawls and try later.
-
@KerryDuggan said in 503 Service Unavailable (temporary?) Rogerbot takes a break:
Hi Kerry/
It says chat is not available right now.
I'll send an email with the same message. -
@awilliams_kingston Hi,
Thanks for reaching out!
My apologies for the delayed response. Can you pop us an email at help@moz.com or message us via chat in Moz Pro and we can look into this for you?
Have a lovely day,
Kerry.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Rogerbot directives in robots.txt
I feel like I spend a lot of time setting false positives in my reports to ignore. Can I prevent Rogerbot from crawling pages I don't care about with robots.txt directives? For example., I have some page types with meta noindex and it reports these to me. Theoretically, I can block Rogerbot from these with a robots,txt directive and not have to deal with false positives.
Reporting & Analytics | | awilliams_kingston0 -
Forgot to cancel and never used this service how can I be refunded??
I was considering starting in online business but decided not to but forgot to cancel 30 day trial therefore I am unable to use the service but yeah I still got billed and I never use the service how can I get refunded?
Product Support | | myintimatebox.com0 -
How to block Rogerbot From Crawling UTM URLs
I am trying to block roger from crawling some UTM urls we have created, but having no luck. My robots.txt file looks like: User-agent: rogerbot Disallow: /?utm_source* This does not seem to be working. Any ideas?
Product Support | | Firestarter-SEO0 -
Rogerbot not crawling our site
Has anyone else had issues with Roger crawling your site in the last few weeks? It shows only 2 pages crawled. I was able to crawl the site using Screaming Frog with no problem and we are not specifically blocking Roger via robots.txt or any other method. Has anyone encountered this issue? Any suggestions?
Product Support | | cckapow0 -
Does the Moz toolset have a monthly reporting function yet? Can't seem to find it in the interface. I'm trialling the software but probably going to move to another service if this isn't available.
Does the Moz toolset have a monthly reporting function yet? Can't seem to find it in the interface. I'm trialling the software but probably going to move to another service if this isn't available.
Product Support | | bobbybaldpatch0 -
Is there an option to purchase only the Followerwonk service?
I am only interested in this service. Also, I am in a demo period and although I've linked my Moz account to Followerwonk, the features are still unavailable to me to test them out. Thanks!
Product Support | | dgadoury0 -
Maintenance Alert: Moz Analytics + Pro unavailable for Maintenance tonight from 7-7:30pm PST
Hello! We've posted this within the apps, as well as on our social channels, but I wanted to share it here as well. We are doing required database maintenance tonight starting at 7pm, Pacific time. This update will help make things work a bit quicker. Woot! The rest of the tools will still be available at http://moz.com/researchtools. Thank you for your patience!
Product Support | | jennita2
