It comes down to upgradability for me. The display is going to last far longer than the smart software running on it. Turning on my TV takes a full minute and a half before it will accept inputs from its remote, I've periodically connected it to the internet to check for updates and in two years there hasn't been a single one.
That's not true for every TV but in general my experience has been the built-in Roku, and other smart TV features are poorer quality than the stand alone sticks and either don't get updates at all or significantly less frequently. Because of the nature of these appliances they aren't as disposable so manufacturers have less incentive to provide those updates and high quality experiences as the stand alone products.
All that smart poor quality software on the TV itself compromises the core functionality of the TV itself which is being a good medium for the display of a user's choice content.