I'm against BMG here, but don't we do this with criminals?
Sending people to prison is revoking their right to freedom.
If you're convicted of a violent crime, you lose the right to arms.
I think there is a case to be made that some people need to have their rights restricted to prevent them from violating the rights of others. But this is not one of those cases.