Housing has become a plaything for the ultra-rich.