HN
Hacker News
Top
New
Best
Ask
Show
Jobs
Comment by kzrdude | Hacker News Reader
Parent
Full thread
kzrdude
·
Raw model size is around 27x2 GB since it's in BF16 format
View on HN
macwhisperer
·
4-bit quant sits at 15.72GB
Reply on news.ycombinator.com