But when poor tenants voluntarily move out, they're usually replaced by someone willing to pay a lot more.
Also, in any given year, a very small fraction of landlords (less than 1/10th of one percent) decide they don't want to be landlords anymore, and an extremely controversial California law called the Ellis Act allows them to decline to renew the lease and stop being landlords.