Government already has the prerogative to set taxes, so you should worry about that exactly to the extent that you currently worry about it. LVT is orthogonal.

Broadly, government is not called rent-seeking because it does things to justify its keep: law, defense, roads, bins, etc etc.

At least I have some influence over my local government and how it spends my tax money. Same can't be said about my landlord and how it spends my rent money.

We already have that. The government is going to get its slice of your money one way or another.