Interesting application. I know sabalaba @ lambdalabs (lambdal.com) is doing some similar stuff -- you two might want to get in touch.