Moz Crawler failing with https redirect?
-
Is there a way to get the Moz Crawl Test to work with HTTPS?
I just got back this error:
902 : Network errors prevented crawler from contacting server for page.
Site is set up with a standard 301 to redirect http to https - or at least I certainly hope it is!
Rex Swain's HTTP Header Checker took shows a standard 301.
Anyone else experiencing this error?
btw - this is both a specific question and an opportunity for open discussion...
Thanks!
-
Hi there - Kristina from Moz's Help Team here.
Unfortunately at this time our crawler isn't compatible with Server Name Indication (SNI), which appears to be in use on your site. In general, SNI is a totally acceptable security configuration, but our crawler simply isn't equipped to be able to handle these settings.
http://screencast.com/t/dB2C3eVJ7gN
I found this thread in our Community Q&A forum with lots of other users running into the same problem, so it's definitely something we're aware of and working to address: https://moz.com/community/q/804-https-ssl-error
The good news is that a recent update has been made, and we're ready to accept beta SNI customers to test it out. Please see the article here that explains this further: https://moz.com/community/q/moz-pro-our-web-crawler-and-sites-that-use-sni and if you're interested in being a part of the beta testing, the link to the sign up page is here: http://goo.gl/forms/LCvL9Ix8JDHfbAvr1
I apologize for the inconvenience in the meantime, but hopefully we'll have it fixed soon! Let me know if there's anything else I can do to help!
-
Hi There,
It seems that your server is blocking the Moz crawler as an activity that it doesn't recognize.
You should contact your hosting provider to get a solution. You can read a similar answer here
https://moz.com/community/q/error-code-902-for-crawl-diagnostics
I hope this helps, please feel free to ask further questions.
Regards,
Vijay
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Server blocking crawl bot due to DOS protection and MOZ Help team not responding
First of all has anyone else not received a response from the help team, ive sent 4 emails the oldest one is a month old, and one of our most used features on moz on demand crawl to find broken links doesnt work and its really frustrating to not get a response, when we're paying so much a month for a feature that doesnt work. Ok rant over now onto the actual issue, on our crawls we're just getting 429 errors because our server has a DOS protection and is blocking MOZ's robot, im sure it will be as easy as whitelisting the robots IP, but i cant get a response from MOZ with the IP. Cheers, Fergus
Feature Requests | | JamesDavison0 -
Are there any plans for a Moz connector to Google Data Studio
Hello all, As title reads, are there any plans for a Moz connector to Google Data Studio to help automate reporting? I'm surprised this doesn't exist already because Data Studio is so heavily used. Thanks in advance. Simon
Feature Requests | | parkersj9 -
Moz is flagging my callto: links as 404s. I "fixed" with tel: & nofollow and lost 2 DA. Help?
I changed the callto: links to tel: links in the footer and nofollowed them and my domain authority dropped 2. I'm assuming this is because we lost 2.8K "external links" Advice on how to remove 404s for Phone#'s without affecting DA? Will just using the tel: format stop Moz from crawling them as 404's? It was adding links to the 404 list that look like this: www.ocp.org/missals/callto:########### I assumed it was because to the crawlers the links looked like relative links this is what our links look like now: <a <span="" class="html-tag">href</a><a <span="" class="html-tag">="</a>tel:###########" rel="nofollow" title="Call us">########### Old footer links: <a <span="" class="html-tag">href</a><a <span="" class="html-tag">="</a>callto:###########" title="Call us">###########
Feature Requests | | OCPmusic0 -
High Priority - Error Code 804: HTTPS (SSL) Error Encountered
I know that Rogerbot has an issue with SSL / SNI technology used with our Amazon Cloudfront setup even though most browsers support it. Is there a timeframe for this to be fixed? If not is there a specific set of instructions or any way for us to get this from showing up on our High Priority list? Thanks! Sean
Feature Requests | | zspace0 -
Moz Weekly Keyword Ranking Received seems inaccurate - Australia
Hi, We have so many website being tracked in Google AU and we see too much ranking change ( both positive and negative ) but all inaccurate from MOZ. Our Manual Testing result matched correctly with Google where as moz results inaccurate. Is there anything happening . Our Website: http://www.gardenshed.com.au/ E.g : Garden shed - Moz Reported Rank #4 - Actual Rank : 11 Garden sheds - Moz Reported Rank #7 - Actual Rank : 23 similarly for all other projects .
Feature Requests | | emarketexperts0 -
Can I embed a Moz report in my own admin site?
I'd like to be able to pull one of the reports that I have on my campaign dashboard on another site (preferably via iframe). Is this possible?
Feature Requests | | m4change0 -
Is there a way to add custom dashboards into Moz's "Custom Reporting"?
I have dashboards set up in Google Analytics that track conversions and year over year traffic data and just wanted to see if their was a way to add those extra metrics Moz's Custom Report? Any help or suggestions would be much appreciated!
Feature Requests | | Gruenagency0 -
Can I add more then 3 competitors do my SEO moz pro account?
I have a client who will need more then the three competitors tracked(possibly up to 10) is there any way to do this with one campaign or will i need to start multiple campaigns to achieve this?
Feature Requests | | BBI_Brandboost8