Right, that's why the baselines here come from the land of Optimal Transport, which looks at the world through isomorphisms, exactly as you've suggested.

The GAN works way better than traditional OT methods though. I really don't know why, this is the part that feels like magic to me.