HumanRF: High-Fidelity Neural Radiance Fields for Humans in Motion
synthesiaresearch.github.io
synthesiaresearch.github.io
New works like this one allow interpolation.
It's fair to ask if this is similar to what we saw in the Matrix sequels, where I believe they used different solutions. But again, I think the Matrix sequels mostly used entirely CG actors...? Not interpolation of recorded acting.
I work in film VFX (related) and the tech that was used for the matrix was nowhere near this.
I dare say you might be underinformed about this topic.
Not really ? Film acting is a delicate art. And it’s 1000x faster than computer animation. You can film a cheap film in 3 weeks maybe, on a tight schedule. The actors will be able to deliver what you need.
Animating the equivalent film would cost you something between 1-3 years.
So no I don’t see a way that any of this will affect film actors. We already have fully functional digi doubles, they just don’t use NERFs.
Pointing a camera at something / someone interesting is still somewhere around 1000x more efficient than computer animation. I don’t see a near or mid future where this changes.
Are there other examples of similar tech in use at a comparable level of quality in recent history? Against any comparable end results I’ve personally seen, it looks very impressive.
[0] https://www.microsoft.com/en-us/mixed-reality/capture-studio...
It's this particular paper that I don't find that interesting given the amount of data they had to work with and very specialized hardware setup.
Do we have the understanding of neuro anatomy today to make a Light Ocular-Oriented Kinetic Emotive Responses (L.O.O.K.E.R.) device? We certainly have the technology.