HN
Hacker News
Top
New
Best
Ask
Show
Jobs
Comment by genpfault | Hacker News Reader
Parent
Full thread
genpfault
·
Seeing ~70 tok/s on a 7900 XTX using Ollama.
View on HN
Matsta
·
I'm getting around 90 tok/s on a 3090 using Ollama.
Pretty impressive
Reply on news.ycombinator.com