Very neat. The first thing that comes to mind is combining this with Processing. I'd like to try making some kind of interactive generative art + music toy.
You might want to look at Overtone, which is a clojure environment built on top of overtone, and which integrates with processing and a few other similar things.