Hacker News Reader

Yeah, got a 24GB 4090, try to reduce the number of frames decoded to something like 4 or 8. Although, keep in mind it caps the 24Gb and goes to RAM (with the latest nvidia drivers).

Oh yes it works, thanks!

Have heard from others attempting it that it needs 40GB, so basically an A100/A6000/H100 or other large card. Or an Apple Silicon Mac with a bunch of unified memory, I guess.

Give it a week.

Alright thanks for the information. I will try to justify using one A100 for my "very important" research activities.

Is the checkpoint default fp16 or fp32?