I even found a rust rewrite of llama.cpp, the cpu performance was horrible and vulkan caused my video to stutter

it was way better/easier to use rust bindings to llama.cpp