Hacker News Reader

I have a 12-year-old desktop with 24GB of RAM and no modern GPU and can run the 7B models, it's just no fun :(

I have a similarly old desktop with 24GB RAM and outdated GPU. What sort of token/second were you able to get with the 7B models?