Can this potentially be used in 2D animation replacing the manual skeletal animating processes?
What company do you work for? This is super cool.
Can you talk about the rest of your stack? Or other projects of a similar nature?
The setup was essentially an app (c++ engine on osx running models), ingesting camera feeds, outputting skeletons, running sound->mouth poses, to unity which puppeteered 2D sprites.
On-set we output to a monitor which mixed the real shots with our graphics.
Nothing crazy! But it was a solid setup (except for overheating DSLRs)
It looks like the interface returns 2D coordinates for the joints, not 3D coordinates; so it can't directly create 3D animation data.
It was also very jumpy in my browser, so it would require smoothing to be usable; or maybe if it wasn't running real-time it would be more accurate?