Welcome to the Q&A Forum

Browse the forum for helpful insights and fresh discussions about all things SEO.

Your browser does not seem to support JavaScript. As a result, your viewing experience will be diminished, and you have been placed in read-only mode.

Please download a browser that supports JavaScript, or enable it if it's disabled (i.e. NoScript).

Moz can't crawl our site

Link Explorer

669

SigneerHFS last edited by

Moz can't crawl our site because of an error in the robots.txt, we've tried everything in the troubleshooting guide but nothing works - I believe its a server error but have no idea how to fix it pls help
1 Reply Last reply
Reply Quote 0
Natalie-Alexis Staff last edited by

Hi there!

We would be happy to look into this for you! Can you please send us an email over at help@moz.com so we can pinpoint what is going on here?

We would also need the URL of the site you are trying to crawl.

We look forward to hearing back from you soon!
1 Reply Last reply
Reply Quote 0

Got a burning SEO question?

Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.

Start my free trial

Browse Questions

View

From

Sorted by

With category

Explore more categories

Related Questions

How to increase the DA of a site?

I have done work on my site for 6 months, and still, I cannot find any progress because the DA in the MOZ is not increasing, and of course, I'm not getting rankings. What should I do now? I have been producing unique and new content too. Check my Site: http://www.apksoldier.com/avg-cleaner-pro-apk/
Link Explorer | | ndjkiu77

0
Using Link Tracking list to track 301 backlinks for my main site backlink profile?

Greetings, I am utilizing link tracking list to keep a track of 301 redirect backlinks to my main site because these links do not as yet show up in my backlink profile on Moz. Will adding these to the tracking list with the redirected domain as the target / source url show up in my main site backlink profile eventually?
Link Explorer | | AkiedoFung

0
Can I change the Link Explorer from check with Google US?

I'm trying to check the ranking keywords for a specific article with the Link Explorer, but when I hover over Ranking Keywords on the Overview it tells me that it's looking on Google US. We're a UK based company and the keywords we're trying to rank for are UK based - is there a way of changing this to match?
Link Explorer | | Kestra

0
Moz error with domain and page authority if no www in my domain

Hello, so our domain is website.com and we do not use www in our domain. Now moz shows our page authority as huge (website. Com) and domain authority very low. But our domain is our page that we rank. Is this due to the fact that we use no www and we rank our main index page? Am I correct? Thanks!
Link Explorer | | advertisingcloud

0
Site has DA of 26 but no backlinks

I'm asking this for a guy over at SEOchat: http://forums.seochat.com/new-user-seo-questions-answers-123/unusual-change-domain-authority-486962.html Here's what his post says: Exclamation Unusual Change in Domain authority
Guys and Girls, I'm having a weird issue in one of my sites , thing is the site had DA 11 in July and however when check on September Site is having 26 without me doing any type of link building and there are no new posts for this month as well. When checked using open site explorer there are no backlinks indexed in their Mozcape index as well. Site: http://www.beijingtravelchannel.com/ Can you give me any plausible reasons for this to happen, so that i can check them out. Thanks in Advance.
Link Explorer | | ThomasHarvey

0
When the site explorer will recognise the new TLD?

Hey, I own a website, called tipster.website I noticed that the site explorer doesnt recognise the domain extension. When they will be added too? I dont know if the other extensions work , but this one definitely doesnt work. ps: majestic.com also don't recognise the extension.
Link Explorer | | nyanainc

0
Difference between Link Analysis and open site explorer

Hey, when i check my links in Link Analysis in Moz Analytics is see 45 Linking Root Domains. The manual states: " If you want to look at these pages in more depth, just click the export button. This will take you to Open Site Explorer so you can dig deeper into your link profile and export the data for review later." But when i go there, the open site explorer states i only have 31 Linking Domains. What could explain the difference?
Link Explorer | | RoderickG

0
Discrepancy between number of links from web master tools and open site explorer.

Hi I am looking at number of link to www.bagnodesignglasgow.com on open site explorer shows as total links 24 but on WMT it says 937 ? Why are these two numbers so different ? Thanks
Link Explorer | | VIVOWeb

0