HN
Hacker News
Top
New
Best
Ask
Show
Jobs
Comment by throwaway7783 | Hacker News Reader
Parent
Full thread
throwaway7783
·
Can you share your local LLM setup?
View on HN
mystraline
·
Its just my desktop running Krasis. 96GB ddr5, 16GB nvidia 5060. Im running qwen-3.5-80B in int4 mode.
It uses like 45GB system ram and 11GB g-ram.
Reply on news.ycombinator.com