Love the idea! Been thinking about this myself for a while. Not having tested this fully, how well does this work in a chromecasted tab?
Similarly, my LG TV is using my smartphone touch screen as the smart remote control.
Slowly, we will be able to control/play everything from our smartphones or smart watches. My pet peeve: remote controlled washing machine.