"Our crawler was not able to access the robots.txt file on your site."
-
Hi Mozzers!
I've received an error message saying the site can't be crawled because Moz is unable to access the robots.txt. I've spoken to the webmaster and he can't understand why the robot.txt can't be accessed as this seems to be fine:
https://k3syspro.com/robots.txt
and Google isn't flagging anything up to us.
Does anyone know why this may be?
Thanks,
Matthew
-
Hey K3,
Looks like you have bigger fish to fry, your host domain is throwing a 503 server error. No server = no content = no robots.txt will be able to be found until that is resolved. Error still happening as of this post: http://downforeveryoneorjustme.com/https://k3syspro.com
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Solved Site Crawl Won't Complete
How can I start/restart a new site crawl? I requested one 2 days ago on one of my sites, and it won't complete. It's only 150 pages -
Product Support | | PaulBarrs0 -
Merging two Sites into One - how is Final Domain Authority Calculated?
Hi, If we merge two sites say, one with DA 35 and another 20 what will be resulting DA of the merged site? Secondly, will the result vary based on which Domain is kept and which one is 301ed? ps :- all content is transferred from one to another using 301. Regards,
Product Support | | Praveenshah10 -
MOZ refusing access to certain sections of the website if using VPN?
I've used PIA and expressvpn before without any problems. Today I got nordvpn and when I try to access my campaigns and link explorer but the connection is being refused while I can access billing and the forum section. I don't have this problem anywhere else atm so I think this might not be a problem from my side but rather from these specific sections. Edit: Any idea what's going on?
Product Support | | Isildur0 -
If I cancel, will I lose all my historical data & be able to access it?
I would like to still be able to view my historical data once I cancel. Will I still have access to it? Thanks.
Product Support | | StudioX1 -
Keyword rankings "soon"?
On the insights portion of one of my campaigns, I continually see this message: " You will see rankings for the 100 keywords we found for you very soon. In the meantime, add more keywords for [XXXXX].It has said "very soon" for quite some time. How do I get this section to work?
Product Support | | seo-nicole0 -
Why can I not crawl this site
I wanted to add this site as new campaign: new.kbc.be But it won't accept it. Why?
Product Support | | KBC0 -
Giving others like employees admin access ?
Hi I have my master logins for Moz but just wandering if i can grant a degree of access to employees via their own logins (just 1 person at this stage) since i dont want to share mine (since use for other stuff too) and ideally dont want them to have full admin permission (such as being able to delete campaigns) ? Cheers Dan
Product Support | | Dan-Lawrence0 -
"Our connection to your Google Analytics account was lost" keeps occurring
We've reauthorized our Google Analytics accounts, but we still keep getting the message "Our connection to your Google Analytics account was lost. Please reauthorize now." This is happening to a handful of our campaigns, not all. Has anyone else encountered this or know what is going on? It says I won't lose any data, but why does this keep happening?
Product Support | | ArtUnlimited0