That is pretty much about right. I wrote a bit about the implementation[1], and the discussion went over how to optimize this (including, but not limited to, using shaders to do the drawing and not relying on Three.js so much).

[1] http://metaphysicaldeveloper.wordpress.com/2011/12/20/implem...