At least for me the problem is that leap seconds are unpredictable. How many seconds are there until January 1st 2020? We don't know, nobody knows. You can only know for sure in 2019. That's bad, that's really bad. Performing internal calculations in TAI doesn't help if conversion between UTC and TAI is undefined for dates more than a year in the future.
Another way to fix the issue would be to define predictable leap seconds, just like leap years are predictable.
But I'd like to see them go. Nobody looks up to the sky and says "the sun is getting later and later". Half of the year most countries are far from solar time anyhow.
Do I care where the sun is relative to some arbitrary line in England? No.