Even Amazon can't make every single ISP in the world provide IPv6 connectivity, which would be required to actually deprecate IPv4 on the server side (or at least at the load balancer or other type of HTTP reverse proxy).
The other option are application-level proxies/load balancers etc., but that's not easy if you want to support all possible protocols.
Network load balancers (NLB) are for other protocols.
This still requires mapping tables similar to explicit port forwarding, and also does not help with e.g. a scenario where all hosts need a specific port (e.g. 443) to be v4 reachable, right?