Welcome to the Q&A Forum

Browse the forum for helpful insights and fresh discussions about all things SEO.

Your browser does not seem to support JavaScript. As a result, your viewing experience will be diminished, and you have been placed in read-only mode.

Please download a browser that supports JavaScript, or enable it if it's disabled (i.e. NoScript).

Moz can't crawl our site

Link Explorer

669

SigneerHFS last edited by

Moz can't crawl our site because of an error in the robots.txt, we've tried everything in the troubleshooting guide but nothing works - I believe its a server error but have no idea how to fix it pls help
1 Reply Last reply
Reply Quote 0
Natalie-Alexis Staff last edited by

Hi there!

We would be happy to look into this for you! Can you please send us an email over at help@moz.com so we can pinpoint what is going on here?

We would also need the URL of the site you are trying to crawl.

We look forward to hearing back from you soon!
1 Reply Last reply
Reply Quote 0

Got a burning SEO question?

Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.

Start my free trial

Browse Questions

View

From

Sorted by

With category

Explore more categories

Related Questions

My Site Facing indexing issues

Hello, I am facing indexing issues on one of my which is about budget bushcraft knife , Four months have been passed I built my site and published almost 7 article so far. But i am worried no any single keyword ranked on google till yet as i checked through MOZ site explorer. Can anyone guide me what should I need to do now. Thanks
Link Explorer | | james11223

0
Why I am seeing only 2 internal links in Site explorer?

Their are lot of links on my site but site explorer showing only 2 internal links. I don't know why. Can anyone help me please?
Link Explorer | | HSgr100

0
Error Message on Moz Crawler

Hi all, Just ran into this issue, when analysing this site. Just got this message when using MOZ "Page Optimisation Error". Anyone know why? It seems to be working fine on other SEO analyser tools. Website is: www.sbpcreativemedia.com.au Thanks in advance! luXS8V5
Link Explorer | | Dushala

0
Why can i see domain links for competitors form social media sites such as pinterest and youtube but not for myself??

When doing competitor analyse i can see that they are getting domain links form youtube and pinterest yet when i analyse my own links i do not have these. My Google analytics shows me that iam getting traffic from these sources so why is it not showing up for me? and is this affecting my moz rank?
Link Explorer | | RobAdair1

0
Internal Pages marked as Spam by Moz

Hello,
We use Moz for our website,Open site explorer marks many of the internal pages of the website as spam. Even pages such as careers, privacy policy etc. Please let us know why is this the case ? Also does these pages have impact on overall rankings of the website ?, If yes, What should we do about it ? Please clarify. Thanks.
Link Explorer | | Umesh-Chandra

0
Why there is high DA for blank brand new sites?

I bought a domain name directly from the registrar 1 year ago. This Domain name has a very good combination of words and .biz extension. I didn't really do anything, I have default wordpress and GA installation. Now I check this site with Moz Bar and OSE and see it has 9DA and 21PA. How come? Quick Facts: Since October last year it has 1000 hits. 9 external links - all links from random domain directories/listings Any ideas how brand new domain name with no original content can have DA9 not DA1?
Link Explorer | | lovemozforever

0
Open site explorer: error message "There was an error getting your data"

I"m trying out MOZ, wanting to make an informed decision (for myself and my blogging students) whether this is a useful program to buy and use. I've had no luck so far with the Open Site Explorer. Each time I try, I get the same error message, "There was an error getting your data". I used the URL: http://writetodone.com I asked about the problem in the chat, but my question was posed over an hour ago and is still marked 'unread'... I"m keen to continue studying the program as I'm creating a video about MOZ. How can I make the Open Site Explorer work? I've tried the Analytics module but it seems to take some days to get results. Mary "There was an error getting your data"
Link Explorer | | MaryJaksch

0
Site Mark-up is Abnormally Small

My site www.brightonsoundsystem.co.uk has been optimised for speed so I have minimised the code needed. Now if I put it through the OSE spam analysis it has a flag for "Site Mark-up is Abnormally Small". What ratio of visible text compared to mark-up code is being used to trigger this flag. Also as this is the only flag I have is ti worth the time fixing.
Link Explorer | | Brighton-Soundsystem

0