Hey another co-founder of Tegon here, currently we only support Open AI models but plan to add local models support with Olamma soon.

There is also COHERE_API_KEY for the vector storage & search: https://github.com/tegonhq/tegon/blob/158b54af8d6f7cf4195c61...

llama.cpp supports being an OpenAI API server, you would just need to change the URL in the Tegon source.