One thing that's being overlooked:
What kind of apps can Apple tout (and we write) when the remote is the only input device?
People said they didn't want another computer, so forget wireless keyboards and mice. Maybe a touch interface with the iPad mirroring the TV? You touch the iPad and the results display on both the iPad and the TV, but that would require you to own another device just to use it to its fullest potential.
When these problems can be reasonably solved, we'll probably have an app store for the TV.