I suspect that being a dongle is part of the appeal of Chromecast for many people.
At least I definitely don't want more visible external boxes behind/next to my TV, especially if they don't even need line-of-sight to the remote since that's all Bluetooth anyway these days.