Hacker News Reader

Looks like only nvidia cards. Can anyone guess how much vram you need for this?

It is currently 26GB, but I will reduce it to under 24GB so that you can at least run it on a 4090.

Have you seen https://github.com/mit-han-lab/nunchaku for running flux on lower VRAM and thus faster performance?

Is it available via API somewhere?