Haha no. You’re basically advocating tax slavery. Freedom of movement is a freedom like any other.
Maybe we need to have the government track where you reside every day, and then your taxes are paid proportional to the communities in which you lived. This would be some sort of “social tax” which is the fair solution.
You don't like the poor, you just hate the rich.