Error Message on Moz Crawler
-
Hi all,
Just ran into this issue, when analysing this site. Just got this message when using MOZ "Page Optimisation Error". Anyone know why?
It seems to be working fine on other SEO analyser tools.
Website is: www.sbpcreativemedia.com.au
Thanks in advance!
-
Hi Jo,
Thanks for your quick reply and investigation. I'l tell our developer to have a look and get back to you.
Thanks again
-
Hi there,
Jo again from the Moz help team.
I'm afraid we're still getting a 520 error when we try to access your robots.txt.
In oder to investigate this further I wonder if you could please ask your website administrator or host for a copy of your server logs so we can see how your server is responding to rogerbot.
Please send your server logs to help@moz.com.
Cheers!
Jo -
Hi there,
Thanks for reaching out!
It looks like we encountered a 520 error when we tried to crawl your site, if you check the Site Crawl tab in your Moz Pro Campaign you'll see that we were not able to access your robots.txt at the time of the crawl.
I'm going to kick off a recrawl at my end to see if this was an intermittent error and we can go from there.
Thanks for bearing with me!
Jo
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
What is difference between Moz data than ahrefs?
hi, On ahrefs it's showing me that my web Fit Food has 1.2k backlinks and 140 referring domain. while on Moz it's totally different stats which making me confuse to understand. So is Domain rating is different than Domain Authority?
Link Explorer | | SophiaRPereira1 -
Can MOZ keyword explorer output sentences instead keywords?
Can MOZ keyword explorer output sentences instead keywords? We need to optimize our website for the Knowledge Graph (OG). There was an old tool that does it, but I can't remember its name.
Link Explorer | | Elchanan1 -
No backlinks reporting in MOZ OSE?
We have a bunch of links and none of them report in MOZ OSE. Does the MOZ OSE tool have a cache that takes a while to refresh? We have recently moved over to CloudFlare and since the move the numbers do not add up. Here is a link to a ahrefs screenshot. Any insights would be greatly appreciated. moz.png
Link Explorer | | seanallen0070 -
803 Errors, how to deal with this?
Hello, During my last two MOZ crawls over couple of hundred 803 errors showed up. Thought that this might stop, but nop still creeping up. Not sure what has caused this. My server providers are WP-Engine and they already said that all good at their end. Pretty much all of those errors are for photos on my blog. I'm a photographer. I have a web guy as well, but he is not sure what to do now and how to get this fixed. Website is a-fotografy.co.uk Thank you and if someone could shed some light. I did research here already, but nothing what cover photo side. Regards, Armands
Link Explorer | | A_Fotografy0 -
403 errors in Moz but not in Google Search Console
Hello, Moz is showing that one of the sites I manage has about ten 403 errors on main pages, including the home page. But when I go to Google Search Console, I'm not getting any 403 errors. I don't know too much about this site (I handle the SEO for a few sites as a contractor for a digital marketing agency), but I can see that it's a WordPress site (I'm not sure if that's relevant). Can I assume this a Moz issue only? Thanks, Susannah Noel
Link Explorer | | SusannahK.Noel0 -
What's with Moz continuously pushing back the Index Update date?
Moz seems to keep pushing back the Index update date, it was the 24th until the 24th, then it got changed to the 30th, now it is may 5th.... What is the reason for this?
Link Explorer | | mgladman1 -
How often are Moz Domain authority and Page Authority Metrics Refreshed?
How often are the MOZ metrics of DA and PA refreshed, this is because i have noticed when i conduct an Inbound link analysis of my blog, i realize that MOZ is merely detecting around 100+ only links to what is being detected on Google Webmaster Tools, any advise?
Link Explorer | | ConnectMedia0