HN
Hacker News
Top
New
Best
Ask
Show
Jobs
Comment by chrsig | Hacker News Reader
Parent
Full thread
chrsig
·
How does one rawdog a 16-bit model?
View on HN
kkzz99
·
Usually, for efficiency, you use quantized models. Quantized models reduce the number of bits available for each parameter, saving space and reduce RAM usage.
Reply on news.ycombinator.com