It's not inflation, it's bad tax policy.
A different tax policy could disincentize this behavior, leading to lower demand and thus lower prices.
That's my current understanding of that perspective at least.
2: a supply shortage develops
3: prices rise, and we don't build more housing
I think the tax policy is prop 13, which is a handout to rich homewoners that means they will never sell their houses (very nice for them, not so for anyone trying to get new housing)