UDP over IPv4 and IPv6 has source IP and source Port in header. This can be used for sticky routing through Load Balancers.
Doing that with NAT is even trickier. Take a look at the way some firewalls need to configure a DMZ for gaming, or SIP for some examples.