"Our crawler was not able to access the robots.txt file on your site."
-
Hi Mozzers!
I've received an error message saying the site can't be crawled because Moz is unable to access the robots.txt. I've spoken to the webmaster and he can't understand why the robot.txt can't be accessed as this seems to be fine:
https://k3syspro.com/robots.txt
and Google isn't flagging anything up to us.
Does anyone know why this may be?
Thanks,
Matthew
-
Hey K3,
Looks like you have bigger fish to fry, your host domain is throwing a 503 server error. No server = no content = no robots.txt will be able to be found until that is resolved. Error still happening as of this post: http://downforeveryoneorjustme.com/https://k3syspro.com
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Crawl still in process for 3 days. Not sure why the site isn't being crawled
I added a new site to the crawl, but it seems to be stalled. It was supposed to crawl Feb 19, but it is still in process Feb 22. It tried to crawl the site and there was a robots.txt issue, but that issue was resolved way before the 19th. Not sure what is going on. this is for the clear lake campaign.
Product Support | | dpsoftware0 -
What is the difference between the "Crawl Issues" report and the "Crawl Test" report?
I've downloaded the CSV of the Crawl Diagnositcs report (which downloads as the "Crawl Issues" report) and the CSV from the Crawl Test Report, and pulled out the pages for a specific subdomain. The Crawl Test report gave me about 150 pages, where the Crawl Issues report gave 500 pages. Why would there be that difference in results? I've checked for duplicate URLs and there are none within the Crawl Issues report.
Product Support | | SBowen-Jive0 -
How can I easily give access to a freelancer?
I want to have my website audited by an external SEO expert and I was wondering if there is a way to give access to my moz account without my billing information and subscription management features. Thanks!
Product Support | | briodf0 -
Cannot Access Moz Analytics
I've been trying to access Moz Analytics for over a month but have continued to see this error message: http://screencast.com/t/GMnN6l9WEI tried on all browsers and cleared my cache. The login works, because I am able to access it on other computers but not on my primary computer. This leads me to believe that Moz' servers are blocking out my computer's IP address for whatever reason.I've tried emailing the help team and calling but have not gotten any sort of response so far. Anyone have a solution?
Product Support | | EvolveDigitalLabs1 -
We are having difficulties connecting to your "Facebook" account.
I keep getting "We are having difficulties connecting to your "Facebook" account. Please go to "Add/Edit Social Accounts" to reauthorize it." then a Moz 404 when I click the Add/Edit link.
Product Support | | iMend0 -
Why hasn't my site info shown up yet?
I set up a campaign a few days ago (middle of last week) and the information still hasn't shown up. I figured that analytics were gathered weekly so I let it sit until Monday, but it still tells me to check back in 24 hours. Thanks for your help! Love the suite, by the way - lots and lots of great tools and easy enough to let my client see what's going on!
Product Support | | JamesMason0 -
"We are collecting your traffic data now!" message displayed for many days
I am getting this message: "We are collecting your traffic data now! You should see your traffic metrics here within the next 24 to 48 hours." for more then 3 days now and I'm starting to worry... Is this showing only to me or is a delay on all MOZ accounts?
Product Support | | SorinaDascalu0 -
How do I access my Full SERP Analysis Report in the new Moz?
Another possibly dumb question... I ran a full SERP analysis report and had it emailed to me, but in the email there's no link to the report. I logged back into Moz, but I can't find the report anywhere. Thanks! BiDFIvG
Product Support | | ScottShrum1