SSL on AWS instances and load balancer

I need some help conceptually-

I have an example setup where I have 2 instances in 2 availability zones on a load balancer. I also have an Elastic IP address, which is not associated with anything yet. I've installed an SSL certificate on the load balancer.

When I check the load balancer DNS, it looks like the SSL certificate is installed correctly, because I can see the issuer is correct. It just says the name does not match, which makes sense because I'm just using the DNS for the load balancer, instead of the correct domain (which points to the Elastic IP).

So my question is, how do I associate the Elastic IP address to refer to use the correct SSL certificate? If I associate the Elastic IP address with either of the instances, the SSL certificate does not seem to be referenced. From the documentation I've read, it seems that you can't (and aren't supposed to) refer the Elastic IP to the load balancer, so what is the appropriate step here to connect the Elastic IP with the load balancer/instances?