Hacker News Reader

Are you taking into account energy costs of running a 3090 at 350 watts for a very long time?

I doubt it’s at full TDP if it’s running at 0.2 tokens per second.

Actually I can't go full tdp with a 650w PSU, I got to upgrade it asap

You can run a RTX3090 at 250w and still get a lot of its performance with nvidia-smi.