Higher taxes don't necessarily mean less freedom with your money; a collective good that a group largely (or even unanimously) in favor of purchasing might go unpurchased due to the free rider problem.
See Mancur Olson's "The Logic of Collective Action: Public Goods and the Theory of Groups"
When you are taxed, that money may or may not go toward something you want to purchase (and many times, the people in the middle and upper classes are paying for programs that they will never use). That money is gone and you have that much less to spend, save, or invest.
You also don't really have a say in where it's spent.
"sharing the value of common resources through taxation and public expenditure" is a related article: http://www.feasta.org/documents/feastareview/robertson.htm