Moz Crawler failing with https redirect?
-
Is there a way to get the Moz Crawl Test to work with HTTPS?
I just got back this error:
902 : Network errors prevented crawler from contacting server for page.
Site is set up with a standard 301 to redirect http to https - or at least I certainly hope it is!
Rex Swain's HTTP Header Checker took shows a standard 301.
Anyone else experiencing this error?
btw - this is both a specific question and an opportunity for open discussion...
Thanks!
-
Hi there - Kristina from Moz's Help Team here.
Unfortunately at this time our crawler isn't compatible with Server Name Indication (SNI), which appears to be in use on your site. In general, SNI is a totally acceptable security configuration, but our crawler simply isn't equipped to be able to handle these settings.
http://screencast.com/t/dB2C3eVJ7gN
I found this thread in our Community Q&A forum with lots of other users running into the same problem, so it's definitely something we're aware of and working to address: https://moz.com/community/q/804-https-ssl-error
The good news is that a recent update has been made, and we're ready to accept beta SNI customers to test it out. Please see the article here that explains this further: https://moz.com/community/q/moz-pro-our-web-crawler-and-sites-that-use-sni and if you're interested in being a part of the beta testing, the link to the sign up page is here: http://goo.gl/forms/LCvL9Ix8JDHfbAvr1
I apologize for the inconvenience in the meantime, but hopefully we'll have it fixed soon! Let me know if there's anything else I can do to help!
-
Hi There,
It seems that your server is blocking the Moz crawler as an activity that it doesn't recognize.
You should contact your hosting provider to get a solution. You can read a similar answer here
https://moz.com/community/q/error-code-902-for-crawl-diagnostics
I hope this helps, please feel free to ask further questions.
Regards,
Vijay
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Can I connect my moz crawl to datastudio to list 404s in a table
Hello I currently export 404s and other 'critical' issues to a google sheet and publish them in a monthly report in data studio Is there a way to automate this process so that my monthly report is automatically populated with critical issues
Feature Requests | | Andrew-SEO0 -
Moz is flagging my callto: links as 404s. I "fixed" with tel: & nofollow and lost 2 DA. Help?
I changed the callto: links to tel: links in the footer and nofollowed them and my domain authority dropped 2. I'm assuming this is because we lost 2.8K "external links" Advice on how to remove 404s for Phone#'s without affecting DA? Will just using the tel: format stop Moz from crawling them as 404's? It was adding links to the 404 list that look like this: www.ocp.org/missals/callto:########### I assumed it was because to the crawlers the links looked like relative links this is what our links look like now: <a <span="" class="html-tag">href</a><a <span="" class="html-tag">="</a>tel:###########" rel="nofollow" title="Call us">########### Old footer links: <a <span="" class="html-tag">href</a><a <span="" class="html-tag">="</a>callto:###########" title="Call us">###########
Feature Requests | | OCPmusic0 -
Moz crawler is not able to crawl my website
Hello All, I'm facing an issue with the MOZ Crawler. Every time it crawls my website , there will be an error message saying " **Moz was unable to crawl your site on Sep 13, 2017. **Our crawler was not able to access the robots.txt file on your site. This often occurs because of a server error from the robots.txt. Although this may have been caused by a temporary outage, we recommend making sure your robots.txt file is accessible and that your network and server are working correctly. Typically errors like this should be investigated and fixed by the site webmaster. " We changed the robots.txt file and checked it . but still the issue is not resolved. URL : https://www.khadination.shop/robots.txt Do let me know what went wrong and wjhat needs to be done. Any suggestion is appreciated. Thank you.
Feature Requests | | Harini.M0 -
One of my Moz Campaigns was accidentally deleted. Any tips on getting it back?
I had a campaign setup with all of my keywords meticulously labeled and branded. Then by mistake, it was deleted. Is there any way I can restore/get the data back for an accidentally deleted campaign?
Feature Requests | | midcenturybliss0 -
Does seo moz toolbar work in safari? Can I avoid using Chrome or firefox?
I am using a Mac and use Safari for web. I am not very familiar with Google Chrome or Firefox. I started my trial with SEOMoz Pro and want to use it (loved it) but do not want to adapt myself to Google Chrome or Firefox - thus my hesitation. What limitations do I have with SEOMoz Pro in safari - e.g. Moz add-on in the toolbar? What would I be missing if I continue using Safari? I would much appreciate an honest and complete answer so that I can decide whether to use Google Chrome of Firefox. Thank you
Feature Requests | | Cenktukel0 -
Migrate campaign from when site changes from http:// to https://
We moved from our site from http:// to https://, redirecting all traffic to the new https connection. However, in our campaign all scores have dropped (only 1 page crawled). Is there something we can do to migratie the data, or update the existing campaign to reflect this minor change to our existing site?
Feature Requests | | BentoPres0 -
High Priority - Error Code 804: HTTPS (SSL) Error Encountered
I know that Rogerbot has an issue with SSL / SNI technology used with our Amazon Cloudfront setup even though most browsers support it. Is there a timeframe for this to be fixed? If not is there a specific set of instructions or any way for us to get this from showing up on our High Priority list? Thanks! Sean
Feature Requests | | zspace0 -
My moz.com profile page authority has vanished.
Hi there Anybody has seen his page authority regarding his own profile page from moz.com vanishing? Mine was aproximately 46, now PA=1 I´ve checked it and nobody is making any comments about this so maybe.... it´s just me :S? Any clues? I loved my link from moz.com!!! Cheers Claudio Heilborn
Feature Requests | | ClaudioHeilborn0