That's a really interesting idea, but can you imagine how incredibly annoying it would be if there were any level of latency? Seems like even a few 10s of milliseconds of latency would make that rather horrible. Especially considering how fast your eyes can dart around a screen, could we even do that today?