Its different from other taxes, that tax an interchange with another person or entity. That is supported by society and its mechanisms, for which government (e.g. all of us) have some responsibility.
But just to start taking what I have simply because I have it, is upsetting at a very fundamental level.