Hacker News Reader

Comment by gregsadetsky | Hacker News Reader

Congrats on the launch!

A few ideas at random:

- could be neat to have the ability to send OSC (i.e. send the same values that you're using to generate the music i.e. limb position / angle / velocity, etc.) so that computer-based synths, video softwares, Max MSP, etc. could ingest it in real time as well

- it would be fun to have different synth "presets" or "patches" which connect limb movement to different parts of the audio generator -- i.e. connect right arm with LFO rather than the oscillator pitch for instance

- just curious, does it support multiple dancers?

View on HN

Thanks! It actually launched some months ago but this is the version I feel confident about to share.

on OSC: I already have implemented this feature in my development version. It would just send the raw body tracking data (joint 3d location). I was not sure though if it would be used by anyone and where to put it, so I did not ship it.

About the presets and general interactive/creative features, please read my answer to wintermutestwin, I am working on it.

It does not support multiple dancers because the "Motion Capture" feature (which is proprietary) does not support it… :/

I’d love OSC for use with Max to control some of my interactive art. Currently using Leap Motion but previously Kinect (too high latency), Wii-mote (great till it gets lost/walked off with) etc.

Hm, I have used the Kinect (2) in the past and thought the latency was quite good actually. If that is too slow for you the iOS body tracking might be as well, I find it has even an even bigger delay than the Kinect. It is also less precise because it relies completely on 2d camera input and a machine learning model. Now I am thinking of putting the OSC feature back in for a future update :)

I am imagining being able to track a guitar's headstock and sending the OSC to act as an expression controller for things like vibrato, etc.

Reply on news.ycombinator.com