Moz Crawler failing with https redirect?
-
Is there a way to get the Moz Crawl Test to work with HTTPS?
I just got back this error:
902 : Network errors prevented crawler from contacting server for page.
Site is set up with a standard 301 to redirect http to https - or at least I certainly hope it is!
Rex Swain's HTTP Header Checker took shows a standard 301.
Anyone else experiencing this error?
btw - this is both a specific question and an opportunity for open discussion...
Thanks!
-
Hi there - Kristina from Moz's Help Team here.
Unfortunately at this time our crawler isn't compatible with Server Name Indication (SNI), which appears to be in use on your site. In general, SNI is a totally acceptable security configuration, but our crawler simply isn't equipped to be able to handle these settings.
http://screencast.com/t/dB2C3eVJ7gN
I found this thread in our Community Q&A forum with lots of other users running into the same problem, so it's definitely something we're aware of and working to address: https://moz.com/community/q/804-https-ssl-error
The good news is that a recent update has been made, and we're ready to accept beta SNI customers to test it out. Please see the article here that explains this further: https://moz.com/community/q/moz-pro-our-web-crawler-and-sites-that-use-sni and if you're interested in being a part of the beta testing, the link to the sign up page is here: http://goo.gl/forms/LCvL9Ix8JDHfbAvr1
I apologize for the inconvenience in the meantime, but hopefully we'll have it fixed soon! Let me know if there's anything else I can do to help!
-
Hi There,
It seems that your server is blocking the Moz crawler as an activity that it doesn't recognize.
You should contact your hosting provider to get a solution. You can read a similar answer here
https://moz.com/community/q/error-code-902-for-crawl-diagnostics
I hope this helps, please feel free to ask further questions.
Regards,
Vijay
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Moz Pricing Needs Update
Hi I am coming from Ahrefs and Moz plans need serious update about the limits especially rank tracking. Ahrefs is providing more keywords $0.08/keyword (5000 keywords for the advanced plan) and update interval of 3 days. Moz large plan is $0.13/keyword with intervals of 1 week. Can this be looked into? Hopefully Moz can improve the limits for keywords ranking/tracking. In 2020 where many rank tracking tools provide daily update, 1 week is a bit ridiculously long. Hopefully Moz can make some improvement in this area,
Feature Requests | | EdmondHong0 -
Are there no tools for evaluating/recommending internal links in Moz?
Everything I've seen using Moz has been great, but there's one thing I can't figure out how to do. All I want to see is some kind of overview or display of my site's internal link architecture, but there doesn't appear to be anything like that in any of the Moz tools? Am I missing it, or do they just not have anything for that?
Feature Requests | | A.S.0 -
Moz crawler is not able to crawl my website
Hello All, I'm facing an issue with the MOZ Crawler. Every time it crawls my website , there will be an error message saying " **Moz was unable to crawl your site on Sep 13, 2017. **Our crawler was not able to access the robots.txt file on your site. This often occurs because of a server error from the robots.txt. Although this may have been caused by a temporary outage, we recommend making sure your robots.txt file is accessible and that your network and server are working correctly. Typically errors like this should be investigated and fixed by the site webmaster. " We changed the robots.txt file and checked it . but still the issue is not resolved. URL : https://www.khadination.shop/robots.txt Do let me know what went wrong and wjhat needs to be done. Any suggestion is appreciated. Thank you.
Feature Requests | | Harini.M0 -
Moz crawler is not able to crawl my website
Hello All, I'm facing an issue with the MOZ Crawler. Every time it crawls my website , there will be an error message saying " **Moz was unable to crawl your site on Sep 13, 2017. **Our crawler was not able to access the robots.txt file on your site. This often occurs because of a server error from the robots.txt. Although this may have been caused by a temporary outage, we recommend making sure your robots.txt file is accessible and that your network and server are working correctly. Typically errors like this should be investigated and fixed by the site webmaster. " We changed the robots.txt file and checked it . but still the issue is not resolved. URL : https://www.khadination.shop/robots.txt Do let me know what went wrong and wjhat needs to be done. Any suggestion is appreciated. Thank you.
Feature Requests | | Harini.M0 -
MOZ Site Crawl - Ignore functionality question
Quick question about the ignore feature found in the MOZ Site Crawl. We've made some changes to pages containing errors found by the MOZ Site Crawl. These changes should have resolved issues but we're not sure about the "Ignore" feature and do not want to use it without first understanding what will happen when using it. Will it clear the item from the current list until the next Site Crawl takes place. If Roger finds the issue again, it will relist the error? Will it clear the item from the list permanently, regardless if it has not been properly corrected?
Feature Requests | | StickyLife1 -
MOZ Campaigns Down?
MOZ Campaigns has been displaying a blank page in the last 2 hours. Is anyone else experiencing this outage? I have attempted to access MOZ via an iPad and an iPhone using Safari and Chrome. My geographic location is France.
Feature Requests | | Kingalan10 -
My moz.com profile page authority has vanished.
Hi there Anybody has seen his page authority regarding his own profile page from moz.com vanishing? Mine was aproximately 46, now PA=1 I´ve checked it and nobody is making any comments about this so maybe.... it´s just me :S? Any clues? I loved my link from moz.com!!! Cheers Claudio Heilborn
Feature Requests | | ClaudioHeilborn0 -
Can I add more then 3 competitors do my SEO moz pro account?
I have a client who will need more then the three competitors tracked(possibly up to 10) is there any way to do this with one campaign or will i need to start multiple campaigns to achieve this?
Feature Requests | | BBI_Brandboost8