you dont get to do that for conditional generation though. When we have a target then we have to generate multiple, pick closest to target, and discard the rest.