HN
Hacker News
Top
New
Best
Ask
Show
Jobs
Comment by qiine | Hacker News Reader
Parent
Full thread
qiine
·
what --no-context-shift is for ?
View on HN
pulse7
·
"--context-shift, --no-context-shift ... whether to use context shift on infinite text generation (default: disabled)"
From:
https://github.com/ggml-org/llama.cpp/blob/master/tools/serv...
MrDrMcCoy
·
That is obvious. Less obvious is what context shifting does and whether you want it or not.
Reply on news.ycombinator.com