HN
Hacker News
Top
New
Best
Ask
Show
Jobs
Comment by atentaten | Hacker News Reader
Parent
Full thread
atentaten
·
What kind of hardware are you using to run the LLMs locally?
View on HN
alienbaby
·
5090 GPU, and on a system with 64GB ram. I'm comfortably running 8b param models
Reply on news.ycombinator.com