Taks a look at: https://github.com/ggerganov/llama.cpp

Facebook's "leaked" LLM.