There is no freedom of association if there is no freedom FROM association.

That is, if your only option is to buy a house within a HOA or not but that house, you're not really free...