There's nothing wrong with the idea. The big issues were mainly around introducing a new tax system and the massive upheavals and uncertainties businesses and people would face as part of the change. Winners and losers, etc. Given the uproar surrounding the later introduction of Universal Credit I'm glad Sir Michael chose not to recommend LVT in his report.
Anyway - anecdote time. One of the big questions we asked at the start of the Inquiry was: "Why tax property?" After long consultations with the most senior Experts and Gurus across Government and Academia the answer came back: "Because it's there."
[1] https://www.webarchive.org.uk/wayback/en/archive/20070411120...
(I'm mainly commenting because it's an opportunity to show off the Inquiry's website. I built that! I had to do it in my "spare time" because we didn't have a budget for the work. This version is from 2007, but the original code was written in 2004 in PHP and after that most of the work was adapting the site to add events, display responses received, etc. Simpler times!)