HN
Hacker News
Top
New
Best
Ask
Show
Jobs
Comment by nightski | Hacker News Reader
Parent
Full thread
nightski
·
$10k to run a 4 bit quantized model. Ouch.
View on HN
OriginalMrPink
·
That's today. What about tomorrow?
water9
·
The M4 MacBook Pro 128GB can run a 32B perimeter model with an 8 bit quantized model just fine
Reply on news.ycombinator.com