They're removed from society to protect society from them. However, depriving someone of their liberty is a pretty extreme step to take, and not one which should be taken lightly.

A TS individual for instance may be annoying, however they aren't causing actual physical harm to other people, in the same sense that a murderer might be.