"Our crawler was not able to access the robots.txt file on your site."
-
Hi Mozzers!
I've received an error message saying the site can't be crawled because Moz is unable to access the robots.txt. I've spoken to the webmaster and he can't understand why the robot.txt can't be accessed as this seems to be fine:
https://k3syspro.com/robots.txt
and Google isn't flagging anything up to us.
Does anyone know why this may be?
Thanks,
Matthew
-
Hey K3,
Looks like you have bigger fish to fry, your host domain is throwing a 503 server error. No server = no content = no robots.txt will be able to be found until that is resolved. Error still happening as of this post: http://downforeveryoneorjustme.com/https://k3syspro.com
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved Moz crawler not crawling on my site
Hi all, im facing an issue where moz crawler is unable to crawl my site. The following error keeps showing Our crawler was banned by a page on your site, either through your robots.txt, the X-Robots-Tag HTTP header, or the meta robots tag. This is my robots.txt file : https://www.wearefutureheads.com/robots.txt I'm not sure what else am I missing.. can anyone help
Product Support | | teikh0 -
I have assigned a Moz Pro seat to someone but they can't access a campaign's rankings report?
Hi there, I'm the account admin on a Moz Pro account. I have assigned a seat to a freelancer who's doing some work for me and they say they can't access a campaign's rankings report? The manage user's section shows them as having a seat license? It's been issued and accepted by them? Any ideas here? Thanks
Product Support | | NineFiftyNine.net0 -
Is there still a way to put in a support ticket with Moz. I cannot find it on the site.
I sent an email a few minutes ago to support@moz.com but don't know if that is a usable address or not. I would prefer an answer from a Moz staffer. Thanks,
Product Support | | RobertFisher0 -
I cancelled a day after my billing date. Will i be able to receive a refund?
I signed up for the trial, and i dont plan on renewing the service at this time. I cancelled it as soon as i received the email notification for renewal, will i be able to receive a refund? thanks.
Product Support | | INFINIT_C0 -
Still no invite to site crawl beta! Why bother?
Well, I was informed that I was en-queue to be invited to the Moz Site Crawl v2. I have several client sites making use of SNI b/c, well... CDN's. What is the point of telling me I may receive an invitation shortly, then hearing nothing back and not being able to crawl their sites... this makes this service 100% useless as I can simply use a couple of different tools (free) to perform the same tasks... don't get me wrong... I would rather use Moz and this is not intended to flame the service as I think it could be great... if only it worked. I cannot justify the lack of response, nor the lack of service (what we intended to use here) for the price. It seems like this is simply a waiting game wherein Moz expects me to pay for this service and THEN I will receive my invite? Is it at all possible that anyone can look into this and/or my invite status. If I cannot sample these features before long, you've lost a solid potential client. (Not my loss)
Product Support | | jmsdonline0 -
"Branded Reports" not branded email
I am a new Moz customer and specifically chose the $149 plan to get "branded reports" My Logo shows on the pdf report but when that report is emailed to the client there is a big black banner at the top of the email that says MOZ! I chose branded reports so that the customer would see my branding not MOZ. This is very frustrating and there does not seem to be a solution from MOZ, I know that you can send the email with my return email address but why do you have to put the MOZ branding in the email.
Product Support | | GEWEB1 -
Can't add "Custom links" in my Moz Profile
Hi, I was trying to add a custom link to my profile but I got an error message: "There was a problem saving your custom URLs" Can somebody look into it for me? Kind Regards
Product Support | | Laurensvda0 -
Is the moz site down
anyone else having issues connecting to any campaign etc on Moz on Sat Oct 19? Even emails are bouncing that are sent to help@moz.com....is it just me?
Product Support | | Rye1