I think there is obviously a balance. The problem is how it is being done. Currently Marin is going through something they call a housing element. They have hired a consultant group from LA to find lots they think would be good and are just rezoning things with a broad brush. I don't think the planners have even been to the county, let alone the town. The plan literally takes some of the vacant parts of town and encourages high density apartments.
The prior affordable housing has also backfired. They did a development 20 years ago that was meant to provide local housing. But, because it had federal backing, it meant anyone could apply. A large number of people who live in the project are people on section 8 and disability with no ties to the region whatsoever. They don't work in or contribute to the community, but rather just get free apartments.
To add insult to injury, many of the homes that were made under the original development became vacation rentals about 10 years after they were built (some expiration on deed restrictions or something).
Here is an example: https://www.airbnb.com/rooms/19192461?guests=1&adults=1&s=67...
Clearly this is not what was intended. There has to be a better way.