Jeffrey Katzenberg Says A.I. Will Eliminate 90% of Artist Jobs on Animated Films
indiewire.com
indiewire.com
Reading this in the context of Sora, this is contingent on:
1. movie or tv show length generation needs to be reasonably affordable,
2. the generated output must look real beyond first look (text is readable, physics is correct, no dream-like morphing),
3. continuity between scenes
4. prompts can accurately produce the artistic vision from directors and producers faster than a human just doing it
5. the public will accept it
I am reminded of a scene in Westworld, where basically a someone can sit a desk and describe in natural language a scene to a computer for instant rendering. The user can now concern himself exclusively on the details of the story. Perhaps roles will transition to becoming full time story tellers, and the minutia of vfx, animating, rigging, 3d models, actors, cameras, set designers, trucks, food, lighting, electrical, location, licensing, permits, etc. all go away.
There will always be a market for handmade.
But, will this translate to less tangible goods ?
Before I would have said we have plenty more to do before A.I takes over. And a.i ( Assisted Intelligence ) would aid those creative process. So it will be 50% job cut in the near 10-15 years, while the other 50% being basically double as effective if not more.
After Sora I think future is quite bleak for a lot of artist. Sora is like 80% there, I think we would be 90% there in 2 years time with 5-10x more GPGPU power training. And in 6 years time 95% there by 2030. Even if it didn't eliminate 90% of job but 80%. The redundancy would mean the job market is flooded with animators and their salary will likely stagnant if not fall.
At the same time I finally understand why Nvidia is worth so much.
Don’t underestimate the last 20%! I don’t think this is just a matter of more training or more data. But yeah, 2-5 more years will not change the outcome you’re describing!
Now I don't know how long it took openai to put together that 10 minute demo video, if they ran 3x the resulting prompts or 100x more and had to cherry pick hard (ie that bird's head, I was expecting heavy morphing of those feathers but they kept their visual consistency, for sure this was not the first attempt with at-glance-perfect result).
Right away, the stock footage market is in danger because content creators will opt for a free (good enough) option, over having to not just pay for, and but look for exactly what they want and need.
There's plenty of other industries that will be affected, I can't say that 80% of people will lose their jobs, these things aren't a switch you flip, it's a gradual process, but over time we'll definitely see jobs made obsolete/optimized.
This technology is the worst it'll ever be, and we've seen how far it got in just a single year with Will Smith eating spaghetti and now Sora.
Isn't this a problem for Hollywood itself? Isn't the strength of Hollywood the capital to hire good actors and effects people etc?
You seem to be assuming that Hollywood will just fire all the actors and save money, but to me it seems more like Hollywood is in the danger zone too?
It'll get better, but I don't think they've been aiming in the right direction if the goal is to replace current production methods.
I think for prod work it needs what the auto1111 plugins have given SD - ControlNet etc, where you have a lot more control over the generation and the text prompt is just a small part of it.
My guess is in the short term it will still be assisted intelligence except that it will be humans assisting AI models as in humans in the loop correcting minor mistakes in the model generated video frames.
I don't understand TikTok, but isn't this same argument older people were making about kids playing Mario Brothers back in the 80s, and TV before that?
The comparison was against 500 artists working for 5 years.
So you don't need to get to "write a script and have it render" but get it to the point where a top class animated film can be made with 50 artists working for 5 years.
Also at that scale it can cost an enormous amount and still be totally fine.
It's interesting you mention Westworld, the first movie to use CGI. It was extremely primitive, 2D, and only for a few seconds. See now CGI in modern movies.
Even if progress halts at Sora's level (the absolute worst case scenario), I think it's good enough to replace some 1-5% of scenes (meaning 1-5% of animators' jobs are ticking down since last Thursday).
They won't go away, they'll be chosen by default by software. Analogous to the vast majority of powerpoint docs, which are shitty and created by people who don't know anything other than some vague ideas and bullet points they want to put down, but nothing about what it takes to make a quality presentation.
Now, they're on basically every frame of basically every film.
I expect the use of AI will be similarly varied in the beginning. It could be used just for background details. It could be used in a hybrid fashion where artists design the characters with reference poses, a storyboard, and maybe even some keyframes, and the AI fills in the gaps. And of course some studios will just be sloppy and use AI to generate larger pieces without fixing the glitches and inconsistencies.
People are sometimes dismissive of AI based on the "fire and forget" prompting modes but don't consider AI-assisted tools or human-assisted AI like inpainting.
When animated hand drawn cartoons (think Disney) were first introduced, film critics said they would never watch it, because didn't have actors in it.
When CGI was introduced, film critics said they would never watch it, because the acting wasn't real.
When 3D rendered movies (think Pixar) were first introduced, film critics said they would never watch it, because it wasn't hand drawn.
Just like cartoons, CGI and 3D rendered movies, AI generated movies has the potential to become a huge market. Maybe not in long format at the beginning, but you bet that short format video platforms such as TikTok and YouTube (shorts) will be flooded with AI generated content soon.
> TBH, they lost me much longer time ago, but I assume it will be a larger transition.
The 'great' thing about platforms like TikTok, is that it'll give a very fast feedback loop on whether the audience is willing to watch it or not. So I expect we'll know whether this transition you speak of will happen or not rather soon. My bet is that it won't, I expect people to watch it anyway.
I think you are just making things up because they make a good argument.
And unlike with Toy Story/Final Fantasy: The Spirits Within/The Phantom Menace, this time there might not even be a novel gimmick/look to sell, as you'll be free to choose any style you like.
GP is actually responding to @throw_pm23, and their number (losing 90% of the audience) seems arbitrary and implausible.
This is already happening to some degree, not usually 100% AI-produced, but AI as a labor saving device or to get some kind of output you couldn’t get before. Presidents playing Yu-Gi-Oh! were practically a genre on YouTube last year, and that’s not all that’s been done with their voices.
There will be a short-lived, knee jerk reaction against AI-created content. But ultimately, if the content looks good, people will wholeheartedly embrace it.
I know I'm likely the minority here, but I really dislike heavy use CGI films, like a LOT.
I suspect there is a market for adult-focused genre-based animated films that where never economically feasible before.
more people will be able to create their own animated films without requiring studios, execs and all the gatekeeping and bs that comes with that.
that's why i think the future really will be in content curation.
unless these companies can find a way to block the average person from having access to the same level tools. which i think they will try and they probably can to some extent.
When the reality is that good AI tools will cause lots of projects to add video content where it wasn't before, or to spend more time creating high-quality video content. And this will undoubtedly involve some new labor.
Once there is unlimited content, maybe I'll just go outside and watch the stars or something.
I mean already now you have an incredibly large fraction of sh*t on spotify, netflix etc. Will it matter if it goes up another factor of 1000x?
Meanwhile hopefully the really creative and interesting content creators will leverage the AI stuff to further take the art forward. They have much more ways to test out alternatives and scenes before committing to a $250M production shoot for example..
the bottleneck (as now) will be awareness. thats why content curation is important
so the question is who will be the gatekeepers of awareness.
right now its centralised platforms and influencer marketing.
maybe in future decentralised platforms will allow you distrubute content and get paid. something like farcaster is maybe a preview of that.
2. writers and artists are very unlikely to be replaced by generative AI, because big corporate models will always be lobotomized and sterilized.
Seems pretty fitting, no? I don't think it's just a metaphor. Any "alignment" detracts from the model.
Most humans are constantly given positive and negative reinforcement to social norms, aligning us. This is not even remotely like a lobotomy.
The only thing I'd count as a "lobotomy" on an AI would be a search-and-delete of a substantial subset of the neurons in the network.
Permanently delete, rather than temporary — ablation studies, which do the same thing, are used to make sure functionality is not compromised.
90% of the existing jobs may be eliminated, but that will free up more artists to work in more animation studios. Therefore, we will see a resurgence in animated films.
When the assembly line came into being, we didn't end up losing all of the workers to the factory - we built more factories instead.
It has major flaws as anyone who has used it can see that are next to impossible to fix.
I could see it at most being an enhancer with a human there to fix the AI flaws.
Lol Minor
Even significant post-processing is easy these days: https://www.youtube.com/watch?v=SHx4xVhfS3w
One of them was only visible after someone else pointed it out to me.
The other was just about in the realm of things I've seen in the pre-AI era where single fixed camera perspectives create odd visuals despite capturing reality.
So no, they are not major.
"Major flaws" look like last year's video output, whose subject has only just gotten around to parodying: https://youtube.com/watch?v=5S0inm1bR08
I was surprised the article didn’t mention voice actors .
Why would studio executives bet on some new talent when they can generate Bruce Willis, John Depp or already put their faces on some less known actors in convincing way.
Then they make a reboot of a reboot of previous generation movies and it rolls ad infitum.
but maybe a good point is that live performance may make a come back.
There’s already too many movies and people get bored watching more of the same. If thanks to AI there’s a flood of cheaper mediocre movies content it could kill the remaining excitement.
Because AI Willis can't sign autographs, do press tours, and get randomly sighted by fans. Hollywood is about more than just content, it's about cult of personality, and to have that, you need a living person.
No real fame was achieved about stupid stuff like opening restaurants or random sights in the town, I think we as society can easily live without that.
There is difference where I could make effort to fly to places where they give autographs and meet with fans but I also don't care enough. I imagine people that do care about that either live close by where they can have easy access or are weirdos.
If you want to achieve almost the same for 0.1% of the cost with 1 very talented person and some computing power (or small team of talented writers/artists), it won't take long and Hollywood's business will collapse. You don't need to pay a cent to that old guy in the video.
Current A-listers will slowly fade while milking their residual fame, but more importantly there won't be a next generation in same way it was till now. A major shift indeed, bigger than Hollywood ever saw. If the quality is there it will be unstoppable and unions won't make any difference, next country with more liberal laws can render very same stuff.
As the cost of producing it drops, AI content may come to be seen as worthless background noise to culture and verified human-made media valued.
Also, hand and face issues are rapidly improving, I can easily believe models like Sora getting used for replacing extras despite the flaws it still has.