Can't work out robots.txt issue.
-
Hi
I'm getting crawl errors that MOZ isn't able to access my robots.txt file but it seems completely fine to me? Any chance anyone can help me understand what might be the issue?
-
I would follow the advise from Roman, I tried to access the file via a few ways as well and it doesn't seem to be an issue to load it at all.
-
Ok, I made a quick test of your robot.txt file and looks fine, making HTTP status code test and shows me 200 code which is ok. Also, you need to make sure that your robot.txt file is accessible for the Moz crawler
- Remember to put your file is in the top-level directory of your web server.
- Also, check if your hosting provider is not blocking third-party crawlers (server level)
Here you can test the status code of your robot.txt file** https://httpstatus.io/ **If you're still having trouble this is the email of Moz help@moz.com
Also, you should check
Best of luck!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved How many sites can I track with one subscription?
Hello, We are currently a MozPro medium member and we are tracking amlrightsource.com but we have other sites we'd like to track as well. Wondering if we can track more sites with this subscription?
Moz Pro | | KassandraSharr0 -
Schema.org Identification issues?
Hello, My question relates to Schema.org identification on specific pages within our site. This may sound very amateurish so please bare with me. Using the MozBar Chrome plugin and looking withing the Markup tab, the results say that MozBar does NOT find Schema.org markup on our page. However, going to the Google Structure Data Testing Tool results in the opposite. I see the Schema.org code and the tool seems to verify with no errors. An example of a page that has Schema.org implemented would be: http://usnews.rankingsandreviews.com/cars-trucks/Acura_MDX/ So the final question is: Should I be worried that the MozBar isn't locating the markup? The results in Google SERP seem to reflect the correct code. thank you!
Moz Pro | | usnseomoz
Chris1 -
Issue: Title Element Too Long !
hello , i found this issue in seomoz campaigns. i see many links blocked by google for this reason . but something wrong here for example i see this link like that in seomoz dashboard Wagdy Hassan, Author at Seo Seek : Seo Tutorials , Seo Tools , Make Money Online http://seo-seek.com/author/wagdys/ and its already not in google. but when i open the link http://seo-seek.com/author/wagdys/ the title is " Wagdy Hassan " i fixed it 6 days ago. what is wrong with the site? also i still waiting google to put the new results .. wait for your answer, Thanks 🙂
Moz Pro | | Wagdys0 -
Why doesn't OSE show results from sites like Wikipedia, YouTube, Twitter, etc.?
I know OSE used to provide link data from these domains. But I have been doing link profile lookups on sites that I know have links from these domains - and they don't show up in my results. Just to make sure, they don't even show up when I sort the sites by domain authority.
Moz Pro | | ProspectMX0 -
Can i give other accounts access
I would like to be able to give limited access to members of our team so they can see SEO campaign results and print off reports without being able to edit the campaigns. Is this possible?
Moz Pro | | wouldBseoKING0 -
Do you have a plan that can comprises up to 70 campaingns?
I have a client that has between 60 and 70 websites. I has recommended to him the setup of at least one campaign per website. However, the bigger plan SEOmoz not covers up to 70 campaigns in a single account. What you recommend to do in this case?
Moz Pro | | Abril1 -
How does SeoMoz works with noindex meta tags?
In my last SeoMoz Crawl I've found a lot of warnings about duplicated content in page with a noindex meta tag. Is that normal? These pages should not be considered as indexable content of my website, isn't it?
Moz Pro | | jgomes0
