How do you install SLL certificate on AWS EC2 instance using ELB?

I installed the certificate on the server (ubuntu) and verified that is working properly and in response i received similar response:

arn:aws:iam::123456789012:server-certificate/my-server-certificate ASCACexampleKEZUQ4K

I have set up Elastic load balancer using the already installed certificate. The ELB shows 1 of 1 instances in services, it also works in http mode using the DNS provided from the installation of ELB. I have also allowed traffic to port 443 https in the security group which is used both from the EC2 instance and the ELB.

Once I point the Domain name in Route 53 to the ELB and start browsing I can still access the page with http, but when I try to switch to https, the page starts loading for about a minute and it successfully loads the https request but the page is blank.

What am I missing?