HN
Hacker News
Top
New
Best
Ask
Show
Jobs
Comment by DominikPeters | Hacker News Reader
Parent
Full thread
DominikPeters
·
Indeed, for each of the words it got it right.
View on HN
bt1a
·
How excellent for a quantized 27GB model (the Q6_K_L GGUF quantization type uses 8 bits per weight in the embedding and output layers since they're sensitize to quantization)
Reply on news.ycombinator.com