My page cant be crawled by MOZ

[zita.vn]

Hi everyone,

I have a page named zita.vn. Im using Moz to do SEO for the page, but when I use On-page grader in MOZ, I got an error that the page cant be accessed. Additionally, I got an issue with page crawling.

Google search still crawl my page normally.

Please help.

Thanks a lot.

[zita.vn]

Hi there,

I have been checking my site for a week, but I havent seen any new updates about my site in backlink. Im sure that since last week there are a few sites pointing a link to my website but I havent found it on Moz.

Please explain it for me.

Tks a lot,

[vcj]

The useragent is: rogerbot

[zita.vn]

Hi Kristina,

Thank you for your answer.

Currently to protect our site from being hacked we need your user agent to add it into our whitelisted, so you will be able to crawl our website.

Regards,

Phuong.

[KristinaKeyser]

Hi there! Kristina from Moz's Help Team here.

When our crawler attempts to access your site, we are running into this error: http://screencast.com/t/CmprKKb7a "403 Forbidden".

This normally means that you're blocking us on a server level. When I ran your site in a header checker I was able to see a 200, but when I curled your site from our servers it returned a 403.

The bummer here is that I can't do anything on the support side to fix this.

This 403 error is coming directly from your server, so at this point the best thing to do will be to send this information to your web dev. They'll need to make sure our crawler (rogerbot) is whitelisted, so our tools can start working hard for you.

As always, you can contact our team on issues like this in the future by emailing help@moz.com, but hopefully this helps point you in the right direction towards a solution here.

Thank you,
-Kristina

[vcj]

I'm seeing a 403 response for your website:

wget zita.vn
--2016-08-02 11:46:09-- http://zita.vn/
Resolving zita.vn... 107.167.188.173
Connecting to zita.vn|107.167.188.173|:80... connected.
HTTP request sent, awaiting response... 301 Moved Permanently
Location: https://www.zita.vn/ [following]
--2016-08-02 11:46:09-- https://www.zita.vn/
Resolving www.zita.vn... 107.167.188.173
Connecting to www.zita.vn|107.167.188.173|:443... connected.
HTTP request sent, awaiting response... 403 Forbidden
2016-08-02 11:46:10 ERROR 403: Forbidden.

If Moz is seeing a 403 they're not going to be able to crawl.

[Mustansar]

there is a possiblity of this issue is due to TLD, as i believe Moz crawler do not support to all TLDs as of yet. this could be the only reason comes to my mind. However, i reckon to raise a suppert ticket for more certian answer for this. 

[Igor.Go]

Maybe you've set a number of threads too high and pause between requests too low? Some hosts will block IPs that send too many requests. How much is too many depends on your host.