NIMBYism is already putting places like Palo Alto, Boulder, etc... well out of reach of the middle class, with a class of "haves" that live there, and "have nots" who have to drive in to work. What would happen to this situation if you killed the subsidy off?
What would it do to the dynamic between generations: older people got a big leg up, and you get nothing?