This is very similar to Johnny Lee's initial exploration with Wii... http://johnnylee.net/projects/wii/