New Sora Demo from OpenAI [video]
youtube.com
youtube.com
The aloof cloud surfer scene helps suspend some disbelief as your eyes are diverted trying to work out what liquid cloud interactions should be. It isn't really workable unless all your output revolves around brainbusting novel physics. Maybe this works for music videos until it gets overplayed.
The main way things get considered highly produced enough to break boredom is to stretch a trend a little beyond expectation in a pleasing way. Think about how fight scenes have changed considerably with no technological changes but always along a trend. It's tough to define a trend and how acceptable a stretch is.
It takes more than melding scenes into each other to make a final product, there is audience back and forth to consider at every level that perhaps AI alone cannot keep up with.
There's also the fact that Luma, Runaway, and Pika are available right now while Sora isn't, even though Sora seems to be a step above them, at least from the cherry picked videos they've shown.
I fully realize there's no meaningful sense in which these models simulate physics, but it's simultaneously very difficult to deny that their output is a strong approximation of reality (at least visually).
I wonder if anyone seriously starts to model physics by throwing huge amounts of AI compute at AI models, rather than attempting to model reality.
There are signs that this is generative ML (legs on the cloud changing positions, weird placement of signs on the car wash), but this is impressively close to perfect.
Would be interesting to see how much compute power this video has required...
Kling (the Chinese Sora basically) is publicly accessible and I don't get that feeling from Kling's videos.
I mean you get the same weird floaty movement they all have, the same kind of glossy sheen (I don’t know how to describe it exactly but all AI images look like they have like vaseline spread over them whenever they go for photorealistic). Extra limbs, too many fingers, impossible geometry, clothing stretching way too far down the body to make any sense.
The first Sora demo was way more impressive. This honestly seems like a step backwards. Like it got worst and isn’t any better than freely available tools people use to make YouTube videos today.