Llama cpp speed is dramatically improved by avx instructions. If your CPU has those it would be much faster than not.
And if it doesn't you need to do some workarounds with compiling and it gets a bit harder to run.
And if it doesn't you need to do some workarounds with compiling and it gets a bit harder to run.
No comments yet.