> how do we adjudicate what is a legitimate part of someone's soul

We think, then we vote; then we think some more, and we vote again. It's democracy, just as for other things.