804 HTTPS (SSL) error
-
Hi Lucas,
You're definitively not going crazy about my name! My business partner created the Moz account and I just changed the name of moz profile to mine as I'll be managing this..hence the confusion.
I am running a wordpress install hosted with siteground and paid for cloudflare plus via siteground, all the site redirects to https as well, no mobile redirect.
I just activated IPV6 compatibility, HTTP/2 + SPDY, set firewall security level to LOW and gave the moz crawl test a try, I'll post my results tomorrow.
By the way, I just took a look at your site and I'm impressed, it's awesome, my website is a local job portal so there's a few good features you have I'm jealous about! I'm not a designer so we went with a "premium" wp template and started tweaking from there. Out of curiosity is your site a custom design solution or is there a way I can get my hands on that theme?
Many thanks again,
Jorge
-
Sorry Jorge, not sure why I called you Rodrigo...
No worries, happy to help, it drove me crazy tooSo, I reviewed my CloudFlare settings, I got firewall security level set to low, no mobile redirect but I do have a redirect on HTTP to HTTPS on all pages.
I also have IPv6 on although I doubt that would make any difference.What I can off is that your application might be blocking the requests maybe, not CF.
Do you run custom code or is it an off the shelf solution like Wordpress?
And do you run it on AWS? EC2 instances or though an ELB?I would suggest as your next step to check if you see any requests from Moz to your server
Just trigger a Crawl test on this link and wait a few hours, you will get the report by email
https://moz.com/researchtools/crawl-testLet us know how it goes
-
Hi Lucas,
Thank you for the quick response. I am using cloudflare plus at moment, and I do have a dedicated IP and SSL with my hosting provider. Would that not be the same as above? I used the dns tool and I do get a constant IP address.
Again, thank you very much for helping on this! - I understand it is not your duty to do so.
-
Hi Rodrigo,
You need to be on CloudFlare Pro which is $20/month to get a dedicated IP address for SSL which will solve your problem.
You don't need to disable browser integrity but you might need to wait a few minutes until CloudFlare adds the IP to your domain. You can check it with a tool like https://www.whatsmydns.net/ -
Hi Lucas,
I am using cloudflare and can't get moz crawler to run even though I have disabled browser integrity and flushed cache. Is there anything else you had to do to have this work?
Many thanks
-
Hi Roel,
I totally agree with you, but Moz seems to be really slow to move on this (it's been over 4 years since python released SNI support).
If you really want to use Moz I would strongly suggest just making the changes on your CDN instead of waiting for them to make a move, and you can always revert the setup once they release SNI support.
Google Cloud supports dedicated IP (they call it a VIP - virtual IP) and it costs $39/month.
You can find some info on how to setup here, I have never done it but seems pretty straight forward
https://cloud.google.com/appengine/docs/python/console/using-custom-domains-and-ssl -
Hi Lucas,
It is possible with most hosting providers, we use Google Cloud Platform and i believe it's possible there. But it involves changing all the certificates from all sites (Our site runs on 12 domains), it's a lot unnecessary work.
Cheers, Roel
-
Guys,
I don't work for Moz and I I know it sucks that they don't support SNI, even if every major browser since IE6 does it, but it isn't a hard fix to add a dedicated IP address for SSL.
If you use AWS you can get CloudFront's dedicated IP for $600/month or you can add CloudFlare Pro for $20/month.
Every hosting company I know provides dedicated IP for SSL so the only issue here is the additional cost.
You guys are paying $100/month for Moz so might as well add another $20 (per domain) and forget about it
Happy to give some guidance with the setup if anyone isn't technical, you should also be able to switch the DNS with zero downtime.Cheers,
Lucas -
The fix we are working on involves a complete re-write of our crawler which will take time to complete. I'm afraid I do not have an ETA but will keep this thread posted with any updates.
-
Hi Moz Users,
Shouldn't it be fixed by now? We got the same problem at https://www.crowdsite.com
We also use SNI on our servers, is there a ATE to fix?
-
Is there any updates on the issues with Cloudflare?
We like Moz but really would like this resolved.
-
If SNI is not enabled with GoDaddy, the other issue would be related to not having intermediate SSL certificates setup.
-
I am also having this issue. I have a GoDaddy SSL on their Managed Wordpress Hosting and just started getting the 804 error in December 2015. Are there any other common things to check other than on GoDaddy, there's not really much to configure there and everything else looks OK.
-
Sounds great Lucas!
Will give these settings to another user to see if it works.
Thanks again!
-
Hi David,
I did some more testing and it seems that the Crawler test was able to scan with the browser agent check on which is good news.
Moz will be indexing our site over the weekend and I can let you know then and confirm everything works as expected.Cheers,
Lucas -
Hi Lucas
Glad to hear you were able to find a workaround! One concerning bit is the disabling of the BrowserAgent security check. Would you be able to check with CloudFlare to see if this is recommended? Your findings may benefit many users that run into this issue and we can recommend this setup to other CF users.
Cheers!
-
So good news on my side, I was able to get the crawler test to work last night
My current setup is- CloudFlare on Pro plan $20/month - you need this because it sets an static IP to your website
- On CF settings, disable BrowserAgent security checks - I still need to review this further but it seems CF blocks Moz's Rogerbot crawler because they cannot verify the user agent
I'll keep you posted on any new developments I have
-
I wish I had a solution for you, but I'm still using SNI via standard CloudFlare so I'm not able to leverage the Moz crawl at all. If you find a solution, it'd be great if you can post it here for myself and the others.
-
Hi there,
We upgraded our site to CloudFlare Pro which supports all browsers that have TLS 1.0 and above - it gives the domain an static IP which means no SNI.
OpenSSL also connects to the domain without any issues but no luck in getting the crawler to work.
I also disabled Browser agent check security on CloudFlare which could be causing issues but that also didn't work.Can anyone point me in the right direction?
Is there any way to get MOZ to crawl a site hosted on CloudFlare or is this a deadend?If someone could provide a bit of code which I can use to test and debug the crawling request without having to use the crawling test tool that would be very helpful.
Cheers,
Lucas -
We too use SNI for our certificates on my co-located server with a top host.
It sounds like you were planning on implementing this since July 2015? It's Christmas Day - 2015, that's a long time Moz.
-
Same here.
We use CloudFront and receive the 804 error response. We consider to cancel our subscription as we get no data and there is no information if and when a solution can be expected.
-
same problem for me.
I am working with https and cloudflare.
what if I disable cloudflare just for the crawl test? would it work? how could I disable it temporarily?
thank you
-
Same problem for us. We are glad to use moz but we have migrated from http to https and nothing works. Do you have any clue if it will be or not in your roadmap developments?
-
Please fix this. I am using SNI certificates from Cloudflare on different domains. IPs are getting rare.
-
Hi-
Have there been any updates to this? We have been using cloudlfare for probably a year and all of a sudden I am getting the 804 errors on our SSL.
Any help would be appreciated.
Ken
-
Is there a way around this? Maybe creating a cname in cloudflare like moz.domain.com and set it to not use their https would that work? Or will all the results be skewed since domain name has changed?
-
At this time they will need their own as we do not support any SNI at this time. With that being said we are aware of it and have investigated solutions but an ETA is not quite yet available. If these are the only sites you planned on using Moz with we won't be of much service at this time =(.
-
Hey there - sorry if there was a miscommunication but we do in fact support SSL, however at this time we do not support SNI (Server Name Identification) which is a technology used to host multiple SSL certificates from a single IP address. If you are currently leveraging CloudFlare or CloudFront we will not be able to crawl your site. If you are using a standard SSL from it's own IP we can most likely crawl that page.
-
My understanding is that Moz can't crawl sites with SSL/Https. I like Moz but if it doesn't work then I can't continue to pay for it then.
This was a response I received from support:
if you tried the suggestions in those posts and were unable to find a solution, then unfortunately it looks like we will not be able to crawl your page at this time. Our crawler has trouble with SSL pages and is often not able to crawl them at all. We are working towards fixing this, but it's a large-scale project. I'm sorry to be the messenger on this. If there is anything else I can help with, please let me know.
-
I too am using CloudFlare and have the same error. I'd like to be notified when you have an update.
Thanks,
Adam -
Hi Lane - Our current crawl libraries do not support SNI which is typically what is enabled by default by Cloud Flare. Our engineering team is still investigating expanding our libraries but an ETA is not available quite yet.
-
I am getting these 804 crawl errors on multiple campaigns/domains
We are using Cloudflare Flexible SSL on all these domains. Can anyone advise on this?
-
Yes, you need to work with Moz support to get the issue fixed.
-
And a 804 is a MOZ error I guess? It isn't something that would show up in a normal crawler?
-
I already did, but they gave me this answer:
MOZ: (there was a question before this one)
I don't think so as the issue is not in loading it or receiving the certificate it is that we cannot translate the certificate or receive an error on getting it.Did the hosting provider state anything about SNI or serving multiple certificates from the same server?That's a bit to technical for me.
-
I just ran a crawl and did not see any 804's
You can view the results here:
You may want to contact Moz directly to see if one of the Moz staff can help you further.
-
Hi Guys
I fixed the issues and the SSL is working fine, but still have an 804 error, so still can't track my campaign.
Hope you can help me further.
-
Hi Jonathan,
Didn't realize this was possible now. For the reasons you stated it still would be advised to get a dedicated IP. The last time I looked at prices they were relatively in-expensive.
-
Actually, many of the larger hosts using cPanel now do not require a dedicated IP as they use SNI technology that allows an SSL certificate to be installed on a shared IP. However, there can be other benefits to having a dedicated IP such as being less likely to get caught on an Email blacklist etc.
-
Hello Happy,
Okay so you have content being served as http on your https page. When you reference an image or script you need to make sure it is a relative reference or a https reference, otherwise you will get these types of warnings.
See Mozilla Facts here
Also see the image attached.
Also the SSL isn't misconfigured it is missing. To configure one properly you need to contact your host and ask them to install a SSL cert (most host will not allow users to do this themselves). If you have not yet purchased a SSL you will need to do so. SSL certs also require dedicated IP addresses which most host also charge for.
In summary if you purchase a dedicated IP and a SSL certification you're problem should go away unless you specifically declare content as http.
Hope this helps,
Don
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved Help with my 4xx Errors
Site Crawler has found a range of 4xx errors on my website. But, the urls aren't ones I've created and instead have the handle of my social channels attached to the end - and I've no idea how this has happened. Any tips or insights on how to fix this would be greatly appreciated.! I've attached a screenshot below:
Link Explorer | | Nathantimothy
Screenshot 2024-04-29 at 14.06.32.png0 -
Account Error
Hey I have Moz account free trail for 30 days whenever I try to analyze website that is based on it show error please solve my problem.
Link Explorer | | cihiloj7770 -
Sudden Spike in 404 Pages Not Found in Moz Crawl But No Errors in WMT
Recently I received a spike in errors from the Moz crawler. When I looked into the matter I noticed that all the URI's looked right but then I looked a little closer and there was a /page/2 and /page/3 in front of the URI's. I'm running a WordPress website. Immediately I thought to myself this must be some kind of caching or permalinks error. So I disabled all my plugins including W3 Total Cache and ran the Integrity Link Crawler for the Mac and found that the errors were still popping up. 404-errors-ncworkercomp.png?dl=0
Link Explorer | | NCCompLawyer0 -
Https in Top Pages Report
Our site migrated to https a year ago but when I ran the Top Pages report, it's listing only http URLs. 1. Why is it only listing http URLs? 2. I'm interested to see which ones 301 redirects to https and which are 200. How can I do this? Thanks!
Link Explorer | | CND0 -
Site moved to https and not showing any Moz DA or PA
Hello Fellow Mozzers, So, I have a client site that we moved from non https to https at the end of 2015. We had decent moz numbers (Da/Pa etc) but now we are only showing a 1 for both of them. Does it usually take time for Moz to carry over the info to the https version or does that process entirely start over? Not sure where to start looking. Cheers D
Link Explorer | | DarinPirkey0 -
804 error preventing website being crawled
Hi For both subdomains https://us.sagepub.com and https://uk.sagepub.com crawling is being prevented by a 804 error. I can't see any reason why this should be so as all content is served through https. Thanks
Link Explorer | | philmoorse0 -
Changed URL from HTTP to HTTPS - 99% of my backlinks don't know though
Hi Moz community, I've got a question about all old backlinks pointing to the http version of my site: Firstly, how it impacts my site's backlinks for SEO and secondly, why does Moz and if you know why Majestic have different metric report values for the different URLs. The Back Story Two months ago I bought an SSL for my personal domain and changed my URL from http to the https version. I 301'd it and can verify that on Majestic SEO using the old http URL. I did this sitewide for an eCommerce site that I'm working and did see a lift in traffic; that was the main reason based on Google talking about sites moving to the SSL Web. I'm No Stranger to 301s Of course all the URLs on my site have been 301'd. I used a HTTPS Redirect plugin for my WordPress site and there's been no issue. I also installed a 404 Checker plugin to log broken external links to my site where I can create a redirect right away in case the HTTPS plugin missed something along the way. I'm comfortable knowing that doing when you change the domain name for a site or just a page going from one URL to another will transfer all the link equity over time. What's Causing the Confusion What's a little confusing is that when I use tools like OSE or Majestic's Explorer, the data doesn't match. For instance in OSE, the https version of my domain has a DA of 1 and PA of 1. But, the http version of my site has a DA of 25 and PA of 36. With Majestic (BTW, please feel free to stop me from asking questions about another tool on Moz, but since we're all part of the same SEO community, I thought I'd ask it here anyway) the Trust and Citation flow values are definitely closely matched but still different values nonetheless. My Question Will I ever see the DA and PA the same for the https & http versions in the future? Does OSE catch the fact that there is a 301 redirect to the https version or does it only recognize that it redirects from http://kingrosales.com to http://www.kingrosales.com when in fact it redirects to https://www.kingrosales.com? My second question is, what about the backlinks? Is it because they are different URLs that OSE doesn't have a way to recognize this and display links from the old http version to the new https version? How will I know the true PA and DA of the https version of my site even with a perfectly executed 301 redirect? lol Let me know if you need more clarification. Thanks
Link Explorer | | KingRosales3 -
How to get backlinks from Https websites with OSE?
Hi guys, Any ideas how can we get/check the backlinks from securized websites (https) using Open Site Explorer? It seems we cannot change the protocol (http:// by default). Thanks,
Link Explorer | | Netsociety
Ben1