I used to have a laptop connected to my TV that I controlled with a small wireless keyboard. It wasn't VLC but MPC, but mostly the same as you're doing.
Then someone advised me on buying a nVidia Shield on which I put Kodi. And from there it was a completely different experience. Just controlling everything from a remote with my thumb, on a unified interface, with more information (posters, synopsis, status of viewing, resuming, sync with my Trakt[1] profile...)
Then I bought a Logitech Harmony remote, so I was able to control my whole setup (TV + soundbar + nVidia Shield) with a single remote.
But I had more and more issues with Kodi, plugins failing, crashes... and with Netflix I took the habit of being able to resume somewhere (browser, smartphone) else what I started on the TV. Something not supported by Kodi because it's only a local player. So I looked at Plex and my experience improved even more.
Now with Plex I have my own "Netflix" so I can start something in a browser at work, resume it on my smartphone in the bus and finish it in my couch on my TV at home. And I can share this with friends and family! I don't have to ask them for a USB key to share files. Or setup a weird FTP access for them to download the files. They have a nice UI to do what they want : consume a media file that they know I have.
It's accessible from everywhere : browsers, smartphone, tablets, media box, smart TV... And I can even play my own music on my Sonos players!
There's a lot of things for which I like to hack stuff and all that. But I don't want to have to do that to watch a movie. I want a simple and user-friendly UX. And that's exactly what Kodi and even more Plex offers.
So to me the first and biggest game changer was to have a smartphone-like experience on my TV, with a small device in one hand I was able to switch apps and enjoy my media in a nice UI.
[1] : https://trakt.tv/