"Our crawler was not able to access the robots.txt file on your site."
-
Hi Mozzers!
I've received an error message saying the site can't be crawled because Moz is unable to access the robots.txt. I've spoken to the webmaster and he can't understand why the robot.txt can't be accessed as this seems to be fine:
https://k3syspro.com/robots.txt
and Google isn't flagging anything up to us.
Does anyone know why this may be?
Thanks,
Matthew
-
Hey K3,
Looks like you have bigger fish to fry, your host domain is throwing a 503 server error. No server = no content = no robots.txt will be able to be found until that is resolved. Error still happening as of this post: http://downforeveryoneorjustme.com/https://k3syspro.com
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Solved Site Crawl Won't Complete
How can I start/restart a new site crawl? I requested one 2 days ago on one of my sites, and it won't complete. It's only 150 pages -
Product Support | | PaulBarrs0 -
My site crawl has been in progress since last week
Hi there, I've been waiting on my site crawl to complete since Friday (it's Tuesday now), but it still has the 'in progress' notification at the top. Is it normal for it to take over 3 days? Or is there something holding it up?
Product Support | | VAPartners0 -
I am unable to access my campaigns. Is anyone else having trouble connecting to http://analytics.moz.com/?
I am unable to access my campaigns. Is anyone else having trouble connecting to http://analytics.moz.com/?
Product Support | | jleite0 -
Giving others like employees admin access ?
Hi I have my master logins for Moz but just wandering if i can grant a degree of access to employees via their own logins (just 1 person at this stage) since i dont want to share mine (since use for other stuff too) and ideally dont want them to have full admin permission (such as being able to delete campaigns) ? Cheers Dan
Product Support | | Dan-Lawrence0 -
Duplicate Content Report: Duplicate URLs being crawled with "++" at the end
Hi, In our Moz report over the past few weeks I've noticed some duplicate URLs appearing like the following: Original (valid) URL: http://www.paperstone.co.uk/cat_553-616_Office-Pins-Clips-and-Bands.aspx?filter_colour=Green Duplicate URL: http://www.paperstone.co.uk/cat_553-616_Office-Pins-Clips-and-Bands.aspx?filter_colour=Green**++** These aren't appearing in Webmaster Tools, or in a Screaming Frog crawl of our site so I'm wondering if this is a bug with the Moz crawler? I realise that it could be resolved using a canonical reference, or performing a 301 from the duplicate to the canonical URL but I'd like to find out what's causing it and whether anyone else was experiencing the same problem. Thanks, George
Product Support | | webmethod0 -
Can I create different login accounts to access different campaigns?
For various reasons, I'd like to create different login accounts for Moz for different campaigns, so staff can only access the campaigns that they're given permissions to. Is this possible?
Product Support | | CapitalFMArena0 -
Unable to Access my Unfinished Campaign
Hello all, I tried to create a campaign for one of my clients but something happened and I had to stop somewhere in the middle. I tried to recreate it but it shows me the following message: “Oops, you already have a campaign named Willoby's Furniture. Please select a unique name for this campaign”. My problem is that I can’t access or see the unfinished campaign. A solution would be to create a new campaign and give it a different name. However, I would prefer to use this space for another client. Any suggestions? Many thanks, Elsa
Product Support | | OptimiseWeb0 -
Why Moz Analytics says that my site had a 13% traffic increase and Moz Pro says that the same site had 3% decrease on traffic?
Every Tuesday The first thing I do in the morning is check my updates on my Moz Campaigns... Today the numbers just don't make sense... How come Moz Analytics and Moz Pro are showing different numbers? Does any one have the same problem? Which one should i trust?
Product Support | | Felip30