A short time later after I found out about Johnny's work I tried to build my own as well and it was great indeed.

When doing research on how to build one, I was having issues with the methodology I was using ( a very naive one), so I actually emailed Johnny asking him for pointers and he actually responded!

His very short email just said (and I quote): "it's called a planar homography"

After digging a lot and tracking some research I found an explanation of the algorithm and things kinds just clicked. It was amazing.

So... if someone reads this and is figuring out how to do something similar, search for that :)

Edit: I actually found the paper!

http://research.microsoft.com/apps/pubs/default.aspx?id=6725...

Very interesting read if you want to figure out how to warp coordinates from a camera to the screen

Thanks for sharing, what a fun and clever solution!