Rai: CPU-only LLM inference engine in pure Rust

github.com

5 pointssimonpure1 comment

Other than being in Rust, how does this compare to a CPU-only build of llama.cpp, which is both easy and already well-supported?