There will always be loopholes and attempts to find them, but that shouldn't necessarily be a deterrent to taking action.
About 70% of my investment income comes through indirect and direct ownership of residential and commercial property. It's just too easy for the wealthy to come in and buy up properties to price others out.
Pay no attention to all those failed states that have already tried this - this time will be different!
Further, your argument doesn’t hold water - food is a requirement, but does it have to be grass fed beef? Could I not make do with soylent green?
This way of thinking is a race to the bottom. It must be avoided at all costs.
What if I own a family farm and want to build a new modern house on some of the property? Do I need to demolish the old one, sell it, be homeless to build a new one?
IMO: the real problem is that it's very hard for individuals to get loans for construction easily (and the ones you can get are extremely risky because the rates can change on you.)