Yes. They're often used as a form of legal economic and cultural discrimination, instead of simply to uphold quality of life in the neighborhood.
Failing to adhere to HOA rules (which may not be readily apparent) results in fines and conflict with a group that's empowered to make decisions about your property. When homeowners have these decisions taken away and are forced to shell out, it becomes a financial and psychological strain that prompts people who would otherwise be enjoying the property to leave (or to not purchase it in the first place).