PrioVR: Get your ideas moving
kickstarter.com
kickstarter.com
I tested it last year and it didn't work too well, but would be very interested to hear if they've ironed out the bugs since then.
We've worked a lot with the inertial sensing technology behind the suit, and have found it to be stable and well-suited to the task of motion capture. The biggest thing that can go wrong with this kind of technology is the presence of large magnets or ferrous objects nearby, but even in the roughest environments we've taken the current version of the suit to(mostly conference halls with giant steel beams running through them), we've always been able to calibrate it to work in the environment. There are also ways to automatically account for temporary magnetic distortions by relying on the gyroscope.
Outside of these sorts of distortions, inertial sensing has always seemed like a solid option for mocap to us, and one with a lot less potential for error than an optical or IK based system. I'd be glad to hear about any bugs anyone has experienced with inertial sensors in the past, and I can let you know what our system does to alleviate or sidestep those issues.
As popular as the Sixense Stem kickstarter is (exceeded its target within hours), its severely limited by the max number of sensors (5) in its working radius for full body immersion (joint positioning in particular) or multiple player usage.
We really need something like this in order to push the boundaries. The alternatives cost a small fortune.
(p.s. Not affiliated, just really want this to happen.)
Accurate motion capture anywhere (think of what we already achieve with GPS and limited device gyroscopic data alone), full body augmented reality (your body is the controller, lol) while walking down the street, the obvious VR and gaming implications, etc.
This is so much bigger than the ability to hit a ball around or wiggle your booty on a TV screen IMHO.
Like you say, range and latency are issues, as well as occlusion, resolution of limb rotations, difficulties with multiple actors in one space, and general inaccuracies due to the system having to make a guess as to the actor's pose and position.
While the Kinect can work fine for simple games, we wanted the user's motions in game to feel natural and fluid, and to be able to extract the whole body pose even if part of the user's body is occluding another part(e.g. hands behind the back, crouched down).
This seems like the biggest remaining problem for creating realistic VR games.
That being said, I still think PrioVR on its own has a lot to offer to games that hasn't been offered before. Imagine a fighting game where you dodge punches by actually ducking down, or a dancing game that can actually capture the full extent of your motion and respond accurately. Both of these concepts could be implemented without any fear of running into a wall, and should present a whole new way to interact with games.
I wonder if the omni harness was more like a baby bouncer than a fixed support if this would solve those issues:
http://static.toysrus.co.uk//medias/sys_master/8609611006271...
I'm assuming with the combination of all the (multiple) inertial sensor data they could probably account for that to a pretty accurate degree.
PrioVR: A system like this provides accurate positioning of all necessary joints in your body to form a true 3d representation of your skeletal orientation without any of the optical limitations or guesswork of the kinect. You could also use it outside, walking down the street, with a laptop in a backpack. i.e. it could be used for augmented reality in any situation.
In the future, I would expect a HMD (some kind of visor - an oculus with a camera in the short-term maybe), a full body suit (like this), and some gloves (the next project these guys will be working on) to be how we augment reality. I don't think we can let this opportunity slide, which is why i'm being so vocal about it!
For me, oculus aside, facial capture is probably the most exciting thing the new kinect can offer (due to increased depth and optical resolution), but it still has all the same limitations as the last one for full body capture (as its basically the same mechanism).
There are a number of full body mocap solutions built by third parties that utilize the data from multiple kinects. This certainly helps, but it still can't be as accurate as something like this, solely due to you being a coloured point cloud blob instead of collection of bones in the softwares eyes.
My full-body mocap needs are mostly sorted, but I'm extremely interested in facial mocap solutions right now because all the existing ones either exceed my budget or suck.
Brekel.com have a less expensive version, but I have no experience with it.
Open source alternatives seem thin on the ground, if not non existent.
Try faceshift, there's a free trial. It's mind blowingly awesome.
How does the setup work? I'm assuming you have to spend a while tying expressions to morph targets on the model?
That said, I have yet to see a convincing demo of the new Kinect, so far only having seen increased resolution on the depth visualisation. By the very nature of the technology it will still have the same limitations as its predecessor.
The technology in the PrioVR may be a more cumbersome than ideal, but the proposed sensors are already smaller than those shown in the visualisation (http://i.imgur.com/oSBEloE.png - the middle ones are the new sensors). As for further miniaturisation, well it has to start somewhere (hence kickstarter, i guess).
As for power usage, this kind of device (low powered sensors with a single wireless hub) combined with a mobile phone and some kind of communication bridge would likely give you hours of full-system use (the PrioVR, this: http://www.kickstarter.com/projects/2041280918/vrase-the-sma... for display and some bridge to access the mocap data on the phone) off a simple 5Ah battery. Or you could go the oculus route, and just have a laptop in a backpack, powering everything through USB.
This isn't just about gaming. This is capturing full body movement for usage in a huge variety of applications. I'm worried that given the current traction this project has, it will fail to fund, and we're going to end up setting back immersive AR/VR for another decade.
I doubt that you could get hours of gameplay. Maybe if you were playing something very simple, you could do hours, but a fully immersive world would destroy battery life.
As for power usage, graphically intense 3d games on the iPhone 5 have about 2-3 hours battery life on a 1.5Ah battery (thats screen, CPU, GPU, etc), so I'd say its still perfectly realistic to expect hours. I don't know the power usage of this kit though, but i would expect it to be low solely based on its function.
The wireless sensor version (which they sell as a professional mocap device) costs about $4000 (which is still inexpensive for a current mocap suit) http://www.yeitechnology.com/productdisplay/3-space-mocap-st... (plus straps).