HN
Hacker News
Top
New
Best
Ask
Show
Jobs
Comment by ggerganov | Hacker News Reader
Parent
Full thread
ggerganov
·
Better keep the KV cache in full precision
View on HN
freakynit
·
Wow.. the GOAT himself.. thank you sooo much for creating llama.cpp ... will re-deploy with full kv cache once requests stop coming.
Reply on news.ycombinator.com