TJ Holowaychuk made something like this a few years ago:

https://github.com/visionmedia/term-canvas