Do you think it is fair for a person who owns $2M worth house to still receive benefits paid from taxpayers money? Because my take on this is: you're millionaire so you can take care of yourself, no public money for you.
Also, no, they wouldn't have to move to Stockton, they wouldn't have to leave their home town. Sell your house for $2M, buy two condos, for $1M million each, move into one of them, rent out the other, and you're set for life, and you will still have your original $2M to pass to your grandchildren after you die. Or you can invest your $2M in ETF, and live in the rented condo, cashing $100k of capital gains profits every year.
For someone with $2M (or 1.5M, or even 1M) net worth possibilities are endless and living off of taxpayers money shouldn't be one of them.