Sure it is. You leave.
A guy I grew up with did this in Queens. He bought a house in the old neighborhood for $200k in the 90s, sold it for nearly $2M, bought an estate upstate for around $500k. His drive to Manhattan is about the same as the shitty bus/subway odyessy without the bullshit. If the weather is awful, he gets a hotel in the city.
HN is weird about this. If we had a king that ended zoning, everyone would be displaced anyway. When your block was ruined by apartment towers and street retail. That’s what happened to my friends former neighbors when his former 50x100 lot was turned into 18 condo units.