Presumably it would also be possible to take steps to adjust the LVT. For example, perhaps the first x thousand dollars of a family's primary home is untaxed.
If the concern is that poor people might be unable to afford to stay in their homes, why not target poverty or house prices directly rather than adjusting the tax?