Hacker News Reader

What GPUs would this require?

It’s got a single line of install instructions. I feel like installation of this sort of thing is usually very convoluted so that’s good to see.

Likely a very small one, or none at all. It’s 450M parameters, which is still in the sweet spot for CPU inference.

I count 3 lines. And that is only if everything works and you have conda etc installed already