Hacker News Reader

Comment by thriftwy | Hacker News Reader

Just run all key frames through stable diffusion and it should be quite good.

I don't think there's such a thing as key frames here, just frames. And if you run SD through every frame, the output will be janky because SD doesn't know about temporal coherence.

Honestly neither does OpenSora it seems, as it is pretty damn janky already.

You can pass a few frames as a single image grid. Then you will get coherence, although it will be very limited by gpu ram.

As soon as it's an MP4 it will have key frames all right. You could add AI upscaling to your encoder. People are making fun of "Just", but I believe I could take apart ffmpeg to add this feature (PoC) in two weeks or less. Provide somebody pays for my labor and for the HW.

>Just

Adding the word 'just' doesnt make it any easier. Something I've noticed is that people who have never done something themselves and are telling someone to do an difficult task, will use:

"Just"

in-front of it.

This is particularly relevant in tech.

It's very likely the comment you replied to said it in a joking sense

It is extremely difficult to tell if the person is joking in a field full of people who think AI is some sort of magic.

Well I mean calling any of this diffusion/LLM stuff "AI" is a misnomer to begin with.

Depends if it's already been done before, in which case "just" would then have been just used quite justly.

Reply on news.ycombinator.com