EDIT: Here is an excerpt from the zoning code of Newark, Delaware, a random smallish city I happened to visit five years ago:
"(1) Minimum lot area. Except as specified in Article XVI, Section 32-56.2(a) of this chapter, the minimum lot area for any dwelling or permitted nonresidential use, together with accessory buildings, shall be as follows: a. RH—One-half acre. b. RT—15,000 square feet. c. RS—9,000 square feet. (2) Maximum lot coverage. The maximum lot coverage for any building, exclusive of accessory buildings, shall be 20%, and the total maximum lot coverage, including any building, accessory buildings, and manmade improvements on the ground surface which are more impervious than the natural surface and which are used for parking and driveways, but not including swimming pools, patios, terraces, outdoor grills, and similar facilities not intended for parking, shall be 44%. (3) Minimum lot width. Except as specified in Article XVI, Section 32-56.2(b) of this chapter, the minimum width of a lot shall be as follows: a. RH—100 feet. b. RT—90 feet. c. RS—75 feet."
It goes on like this for hundreds and hundreds of pages.
[0]: There was some of this in NYC when Robert Moses was the central planner, but it's hard to argue it's continued today.
According to this site, rental prices in Houston were less than a third of prices in San Francisco in June 2017 ($1046 vs $3441).
That sort of difference is certainly going to drive away less affluent people.
These regulations appear to deal with things like setbacks, street access, etc. but it sounds like you can do whatever you want on the land. I think these regulations are just to deal with how to divide up a parcel of land, rather than to regulate anything you do with it.