If you're trying to model something like an Xbox controller with a touch surface, then, as you say, no chance.

If you're trying to model something simpler like a WiiMote, then I think you might hit closer to the mark. Let's keep in mind too the fun possibilities of asymmetric information games that are possible because of the display (think poker, football, Scrabble, Wii U type-games, etc).