HN
Hacker News
Top
New
Best
Ask
Show
Jobs
Comment by 7speter | Hacker News Reader
Parent
Full thread
7speter
·
You can offload the vision projector to CPU/sysRAM
View on HN
slim
·
Awesome. How would you setup that ?
skirmish
·
--no-mmproj-offload
See the documentation:
https://github.com/ggml-org/llama.cpp/blob/master/docs/multi...
Reply on news.ycombinator.com