How can I solive this ?
-
-
It looks like there is still a connection timeout for the non-www version of your site and robots.txt file
I've run a test using this tool again
And this is what I'm seeing:
https://www.screencast.com/t/ll7WdleY9f
Our crawler always starts with the non-www version of your site and crawls from there.
To fix this I would recommend speaking to your website administrator or host about correctly redirecting your non-www pages so we can crawl your site.
I hope this helps!
Jo
-
Hello Jo,
Here's my robots.txt file : https://www.hero-t3ch.com/robots.txt
-
Hi there,
I've tried to access your robots.txt file and I'm getting a 502 error.
https://www.screencast.com/t/QP3b08E86qP
You can use this third party tool to see this response http://httpstatus.io/
If we can't crawl your robots.txt file we can't crawl your site.
I would recommend reaching out to your website administrator or host to find out how you can solve this error.
If you're still stuck please reach out to the help team help@moz.com.
Thanks!
Jo
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Website can't be crawled
Hi there, One of our website can't be crawled. We did get the error emails from you (Moz) but we can't find the solution. Can you please help me? Thanks, Tamara
Product Support | | Yenlo0 -
I'd like to completely delete my account in here. How can I do that?
I just don't want to have this account anymore. So there has to be a way to delete it.
Product Support | | PriiduT0 -
How can I find details when Campaign was created and by Whom in my account?
I have 5 seats in account, How can I find out who created or modified campaign?
Product Support | | ITWEBTEAM0 -
Can you please cancel my subscription and refund the amount
Hi I got charged on my card without my approval and nay knowledge of exact amount before. can you please cancel my subscription and refund the amount immediately as i forgot to cancel free trial and have not used free trial account... also the cost is not approved in my organisation and i cannot bear cost of MOZ on organisation behalf
Product Support | | prashantk180 -
Can i Have multiple Users on Moz. I want to give access to someone.
I want to provide an employee access to moz. Sharing my personal login and password is always risky. is there another way?
Product Support | | prestigeluxuryrentals.com1 -
Moz Pro Reports - Can I create Monthly client reports?
I am just trying to work out if I am able to create monthly SEO reports? I see that when setting up a custom report in my campaigns, i can get it to run daily, weekly or monthly. But i'm just double checking that if i set the reports to run monthly, its going to collect all of the data from that full month, not just grab the data from the most recent week? Thanks
Product Support | | SWD.Advertising0 -
I can't pull September monthly report, only August available, please help?
When i try select date range for my September report, monthly report is not available, it only shows weekly report. August monthly report is available and not September but we are already in October.
Product Support | | francoismuscat0