The certificate is not trusted in all web browsers. You may need to install an Intermediate/chain certificate to link it to a trusted root certificate - Help - Let's Encrypt Community Support
What Is SSL Handshake & How Do I Fix SSL Handshake Failed?
sslshopper.com - Make your website better - DNS, redirects, mixed content, certificates