I haven’t used standalone Kodi, but with LibreELEC, I don’t share this experience. It runs really nicely on my Raspi 3, and I can control it via my TV‘s remote. It pretty much feels like it’s running on the TV itself instead of the (not so) smart built-in features. The UI is a bit slow at times, but definitely not annoyingly so.
The default configuration is quite good and usable, and I didn’t feel the need to change much.