The lack of symmetry bugs me - if a couple swaps wives, why isn't it ever called "husband swapping", and wouldn't the (technically, and politically) correct term be "partner swapping"?
Or maybe it can all be subsumed under "swinging" or whatever the modern term is?