That would be an interesting idea. Isn't there already a controller for some console that implements that?

Edit:

It may be the Wii U, I'm not sure.