Error Message on Moz Crawler
-
Hi all,
Just ran into this issue, when analysing this site. Just got this message when using MOZ "Page Optimisation Error". Anyone know why?
It seems to be working fine on other SEO analyser tools.
Website is: www.sbpcreativemedia.com.au
Thanks in advance!
-
Hi Jo,
Thanks for your quick reply and investigation. I'l tell our developer to have a look and get back to you.
Thanks again
-
Hi there,
Jo again from the Moz help team.
I'm afraid we're still getting a 520 error when we try to access your robots.txt.
In oder to investigate this further I wonder if you could please ask your website administrator or host for a copy of your server logs so we can see how your server is responding to rogerbot.
Please send your server logs to help@moz.com.
Cheers!
Jo -
Hi there,
Thanks for reaching out!
It looks like we encountered a 520 error when we tried to crawl your site, if you check the Site Crawl tab in your Moz Pro Campaign you'll see that we were not able to access your robots.txt at the time of the crawl.
I'm going to kick off a recrawl at my end to see if this was an intermittent error and we can go from there.
Thanks for bearing with me!
Jo
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
My company has about 70 live pages. Moz crawled 6k. Why?
My company has about 70 live, published pages on our website, which is managed through HubSpot. When Moz crawled the URL, it found 6K+. I noticed several were URLs with a campaign tag. Is this normal? It seems excessive to me. If there's a problem, how do I fix it?
Link Explorer | | ActionableResearch1 -
Domain Authority (DA) in Moz Pro changed only within the last 1-2 months?
Has anyone noticed that the Domain Authority (DA) as reported in Moz Pro has changed only within the last 1-2 months? We have screen shots showing plots of DA vs competitors w/ line graph 2 months ago starting in NOV 2017 which today starting JAN 2018 and comparing shows DA up to 50% different!
Link Explorer | | Amplitude_Digital
The change is seen both in the Links Overview and under the Spam Score sections still marked "NEW". Can Moz confirm that it's only recently within the last 2 months that in Moz Pro the NEW DA numbers have retroactively been updated even though the new Link Explorer has been publicly out since APR 30 from https://moz.com/community/q/moz-s-new-link-explorer-including-our-revamped-index-and-da-pa-scores-is-now-open-to-everyone? Look at the top green line starting ~12 months ago on both graphs, w/ old below 40 and new above 50. We've seen even greater differences for other tracked domains. Thanks! view0 -
Different numbers in Moz bar vs. OSE
Hi, On a Google SERP, when i activate the MOZ toolbar one of the sites says it has 1,258 links / 667 RDs. But when I open this same site up in OSE I get 3 inbound links (see attch). What's going on? 0Au9H
Link Explorer | | sanjosepainting0 -
My title has a TM symbol and Moz says I don't have the keyword in my title
Moz gave me a poor rating because I don't have the keyword in my title but I do, it just has a trademark symbol. Pelican 1500 Case is the keyword I'd like to rank for on this page: http://www.thepelicanstore.com/pelican-1500-case-1014.aspx Moz says the keyword doesn't exist on the page. Should I ignore it, remove it or otherwise change it? I feel the trademark symbol would help with CTR in the title.
Link Explorer | | bREALmarketing0 -
Why is moz telling me I have duplicate content, but neither the content nor the urls are duplicates?
I just upgraded our website to a new one. This is the first crawl of the new website. It is telling me I have 24 Critical issues, all of which are duplicate content errors. Thing is, the urls are not duplicates and the content on the page is not duplicated either. Example, here is one error where it says there are two duplicates: <colgroup><col width="595"></colgroup>
Link Explorer | | damon1212
| http://winterguardtarps.com/portfolio-item/props-10 |
| http://winterguardtarps.com/portfolio-item/props-2 |
| http://winterguardtarps.com/portfolio-item/props-7 | There are photos in our portfolio, and none of them are the same. I'm a bit of a noob, but what am I missing here?0 -
What's with Moz continuously pushing back the Index Update date?
Moz seems to keep pushing back the Index update date, it was the 24th until the 24th, then it got changed to the 30th, now it is may 5th.... What is the reason for this?
Link Explorer | | mgladman1 -
Duplicated content detected with MOZ crawl with canonical applied
Hi there! I have a slight problem.
Link Explorer | | Eurasmus.com
I have a site with Joomla 3.3 that we recently migrated from 2.5. Joomla, for some reason that I don´t really get, creates hundreds of weird urls for the site like
mydomain.com/en -> joomla creates en/home/149-xxx-xxx/xxxxxx-xxxxxx that links to the first one.
The new version 3.3 knows this bug and applies a rel=canonical to the ones created "artificially", so they should not be identified as duplicated. Sample piece of code: en/home/149-all-en/xxxxxxx-xxxxxx" rel="canonical" / MOZ crawler identifies this as duplicated and like this I have thousands of pages duplicated all with titles, content etc... all the ones created by joomla. Still my site has good SEO results and I can not see any penalties but I am a bit concerned they may come in the future.... Can anyone explain me what is happening? Thank you in advance for your time,0 -
How Is a Page Crawled by Moz When Moz Says 'No Links'?
As above, really. I've crawled a new client's site to find the Moz crawler has identified a handful of 404 errors. The Moz crawler says these pages have '0 linking domains', and OSE has no data for these pages. So how are these pages being crawled by Moz and what should I advise my client?
Link Explorer | | xerox4320