Plugging a project of mine: I've been working on a similar idea for the era of LLMs: https://butterfi.sh.
It's much more bare-bones than Fig but perhaps useful if you're looking for an alternative! Send me feedback!
It's much more bare-bones than Fig but perhaps useful if you're looking for an alternative! Send me feedback!
This is a dangerous assumption. Not all commands are lowercase. Interaction with an external service should be a deliberate, discrete action on the user's part.
FWIW, from my understanding llama.cpp is pretty easy to integrate and is reasonably fast for being API agnostic. Ollama embeds it, for example. No pressure, just pointing it out :)