Wow that was super easy. I tried this on one of my sites and it really took me like 2 minutes total to add SSL to it.
The only confusing part was that port 443 was blocked in ELB by default (which made it look like it didn't work but got fixed easily as soon as I figured it out). I've never seen an easier way to do this till date.