My page cant be crawled by MOZ
-
Hi everyone,
I have a page named zita.vn. Im using Moz to do SEO for the page, but when I use On-page grader in MOZ, I got an error that the page cant be accessed. Additionally, I got an issue with page crawling.
Google search still crawl my page normally.
Please help.
Thanks a lot.
-
Hi there,
I have been checking my site for a week, but I havent seen any new updates about my site in backlink. Im sure that since last week there are a few sites pointing a link to my website but I havent found it on Moz.
Please explain it for me.
Tks a lot,
-
The useragent is: rogerbot
-
Hi Kristina,
Thank you for your answer.
Currently to protect our site from being hacked we need your user agent to add it into our whitelisted, so you will be able to crawl our website.
Regards,
Phuong.
-
Hi there! Kristina from Moz's Help Team here.
When our crawler attempts to access your site, we are running into this error: http://screencast.com/t/CmprKKb7a "403 Forbidden".
This normally means that you're blocking us on a server level. When I ran your site in a header checker I was able to see a 200, but when I curled your site from our servers it returned a 403.
The bummer here is that I can't do anything on the support side to fix this.
This 403 error is coming directly from your server, so at this point the best thing to do will be to send this information to your web dev. They'll need to make sure our crawler (rogerbot) is whitelisted, so our tools can start working hard for you.
As always, you can contact our team on issues like this in the future by emailing help@moz.com, but hopefully this helps point you in the right direction towards a solution here.
Thank you,
-Kristina -
I'm seeing a 403 response for your website:
wget zita.vn
--2016-08-02 11:46:09-- http://zita.vn/
Resolving zita.vn... 107.167.188.173
Connecting to zita.vn|107.167.188.173|:80... connected.
HTTP request sent, awaiting response... 301 Moved Permanently
Location: https://www.zita.vn/ [following]
--2016-08-02 11:46:09-- https://www.zita.vn/
Resolving www.zita.vn... 107.167.188.173
Connecting to www.zita.vn|107.167.188.173|:443... connected.
HTTP request sent, awaiting response... 403 Forbidden
2016-08-02 11:46:10 ERROR 403: Forbidden.If Moz is seeing a 403 they're not going to be able to crawl.
-
there is a possiblity of this issue is due to TLD, as i believe Moz crawler do not support to all TLDs as of yet. this could be the only reason comes to my mind. However, i reckon to raise a suppert ticket for more certian answer for this.
-
Maybe you've set a number of threads too high and pause between requests too low? Some hosts will block IPs that send too many requests. How much is too many depends on your host.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved New Moz Bar not working in my domain
Hello, I have installed the new version of Moz Bar in Google Chrome.
Moz Bar | | Alberto D.
My problem is that it analyzes all domains except mine: https://elchesemueve.com
I also can't find my country (Spain) to configure the site.0 -
In MozBar Page Analysis under General Attributes Country is empty or wrong
Some of our clients sites have a top level domain for Mexico, but in the Mozbar they doesn't show any country, is this related to a known bug? https://www.edacom.mx/ https://www.dropbox.com/s/a8jgr7ztk1im15k/Captura de pantalla 2019-08-15 12.41.10.png?dl=0 https://www.cliento.mx/ https://www.dropbox.com/s/a8jgr7ztk1im15k/Captura de pantalla 2019-08-15 12.41.10.png?dl=0 In the search console: "International Targeting report" the target is Ok to Mexico.
Moz Bar | | Andrea_Ugalde1 -
Links and images in custom css are not recognised by Moz Toolbar or Yoast plugin
Hi, I am building a website in Wordpress and when checking the pages through Moz toolbar or Yoast plugin, I notice that these don't recognise the internal links in custom CSS and the images neither. Here some code to clarify how it is built: [vc_row][vc_column width="1/2"][ultimate_heading main_heading="Veldrijden" alignment="left" main_heading_margin="margin-bottom:20px;"][/ultimate_heading][vc_single_image image="6497" img_size="full" onclick="custom_link" link="http://k488239.hosting.kinamo.be/activiteiten/veldrijden/"][vc_btn title="Meer info" color="mulled-wine" align="left" link="url:http%3A%2F%2Fk488239.hosting.kinamo.be%2Factiviteiten%2Fveldrijden%2F|||"][/vc_column] The links are embedded in images and in 'More info' buttons. Also the internal links in the main website navigation are not recognised, but the normal a href links are recognised. For the images it is a little different: the alt text from the images gets recognised by Moz, but Yoast says there are no images on the page. The only thing I can think of that there is no 'a href' in the links and for the images that it has something to do with the page builder. Can this effect my SEO results? Thanks.
Moz Bar | | Mat_C0 -
Significant difference with DA scores on Moz Chrome app VS Website Tool
I saw a big difference between DA scores on Moz Chrome app VS Website Tool. Which DA score is the correct one? I personally believe the scores on Moz's site is most accurate. Do you happen to have issues syncing the scored to your Chrome app? Chrome App VS. Moz Research Tool (https://moz.com/researchtools/ose/)
Moz Bar | | iPrice_Marketing
Moz.com: 92 / 88 Here's a screenshot of the difference: https://ipricegroup-my.sharepoint.com/:i:/p/jeremy_chew/ESy9lzUTC3lOl8o93Sx6LsUB8mYXo8LmYuUj2aa0xLXi1A?e=A6OrXs This was evident in other websites too:
Priceza (priceza.com.my😞 38 / 24
Shopback (shopback.my😞 43 / 41
Cuponation (https://www.cuponation.com.my/😞 27 / 250 -
Crawl Notifications
Hi, I'm well aware that the title's for all of my blog post are longer than the recommended length. How can I tell moz to ignore that? I hate seeing 80 plus crawl notifications all regarding this.
Moz Bar | | prestigeluxuryrentals.com0 -
Moz Content --- for SEO or simply user engagement?
What is the primary function of Moz Content? It looks like it is most useful for managing content as a user engagement tool. Our content strategy is centered on boosting organic placement - with user engagement as a nice but unessential side product. Besides providing general descriptive details of a site's content / authorship - how can Moz Content help with SEO?
Moz Bar | | cvonhassell0 -
I am doing the On-page SEO for a website that's never had any SEO done before. I will start with the Pages. Is it necessary to do SEO/Keywords for older Posts?
Using the On-Page Grader to perform SEO on pages of WordPress website. This website never had any SEO done before. Should I go back and perform the same work on the Post Pages?
Moz Bar | | Joseph.Lusso0 -
On Page Grader Returning Large # of Keywords
When using the on-page grader the results show the below for a page with a specific keyword in the body only 5 times : We found this keyword used 1100 times. Any Idea why this would be showing such a high number? The keywords are in Thai language but there is a space before and after the keyword. Thanks.
Moz Bar | | brettjohn670