Error Message on Moz Crawler
-
Hi all,
Just ran into this issue, when analysing this site. Just got this message when using MOZ "Page Optimisation Error". Anyone know why?
It seems to be working fine on other SEO analyser tools.
Website is: www.sbpcreativemedia.com.au
Thanks in advance!
-
Hi Jo,
Thanks for your quick reply and investigation. I'l tell our developer to have a look and get back to you.
Thanks again
-
Hi there,
Jo again from the Moz help team.
I'm afraid we're still getting a 520 error when we try to access your robots.txt.
In oder to investigate this further I wonder if you could please ask your website administrator or host for a copy of your server logs so we can see how your server is responding to rogerbot.
Please send your server logs to help@moz.com.
Cheers!
Jo -
Hi there,
Thanks for reaching out!
It looks like we encountered a 520 error when we tried to crawl your site, if you check the Site Crawl tab in your Moz Pro Campaign you'll see that we were not able to access your robots.txt at the time of the crawl.
I'm going to kick off a recrawl at my end to see if this was an intermittent error and we can go from there.
Thanks for bearing with me!
Jo
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved Moz link explorer is how much reliable and accurate as compared to others link explorer tools like Ahref
Hi.. I need to check backlinks for one of my client website duplicatebills through Moz Pro link explorer tool then its show that linking domain to this website are 90 but when i cross check these links from other tools like Ahref free backlinking tool then its show a different figure (ahref show that linking domain to this website are 103).
Link Explorer | | dbills
I am confused that which one correct. And MOZ link explorer tools in reliable to which extent?0 -
MOZ DA IS NOT INCRAESING
Hey my website on business cards its DA is not increasing. is there any way to increase its DA.
Link Explorer | | cartwrightkar0 -
Why Moz is not providing keywords data above 300K
When we extract keywords of a website, moz shows us 300K results, they are enough but, why moz is not showing all keywords data
Link Explorer | | nkodiou1 -
My site links to my clients not showing in Moz
I've got a web design business with a site that's been out there for 17 years - www.biztoolsone.com. I've got links to my clients' sites in my portfolio page. The backlinks list for my clients, when I check them in Moz, don't show the links from this site. They always showed in the list until a few months ago. The site has a DA of 59 & PA (for home page) of 50. The spam score is 0/17. I'm having a tough time telling my clients that the Moz backlinks list is accurate when that site doesn't show in the list. The same is true for www.fayettevillenc.biz - this is one I created years ago to generate backlinks. It's got a spam score of 4/17, so I'm a little more understanding of that one. Thanks for any guidance!
Link Explorer | | wcksmith10 -
Does the Moz Pro site crawl, crawl password protected sites?
So i asked Moz Pro site crawl to crawl my page, and a lot of issues came up - but for password protected sites. Does the Moz Pro site crawl do this? A lot of the issues, are not relevant for a site that is password protected.
Link Explorer | | Minlaering.dk0 -
Weekly and other data not available in moz tools
Dear All, Since last few days we are not getting updated results in moz tools. We get following warnings in the pages. "Hello! Weekly data for some campaigns is a bit behind schedule. Don't worry; it's processing now and will be available soon. Check out http://health.moz.com for the latest status on all of our tools. And thanks for your patience!" How much time it will take to show us the current results, so that we can properly work on it. Right now we are not able to measure any changes affected our site. Thanks, Om
Link Explorer | | omverma0 -
Is there some way to tell the Moz crawler not to crawl URL's with particular dynamic tags such as "?redirect-to:http//" ?
We are encountering an issue where the crawler is finding a ton of pages from our wordpress login url that has this dynamic tag in it to kinds of different blog entries. It's madness. I can't figure out what is causing these URLs to generate to be crawled in the first place! Does this sound familiar to anyone out there, any constructive suggestions? Robots text or maybe meta robots tags that would resolve this crawl issue?
Link Explorer | | RegistrarCorp0 -
The difference between the statistics MOZ & Ahrefs
Hello dear. I have a website for a year. I made 10K links in one year(from 45 Root Domains).the Ahrefs.com has show full list of link root domains and pages. the ahrefs rank is 49. but MOZ said my Established Links are 5! So I have some questions, please help me: 1- what is difference between MOZ rank and ahrefs rank? 2-When Just-Discovered Link Calculate for my site? 3-why my moz trust is 0.00!?How to improve it? URL: https://esta-register.org
Link Explorer | | allyunit0