HNHacker News
TopNewBestAskShowJobs

mwieler

1 karma · joined April 30, 2013

submissionscomments
mwieler··on Structured Outputs with Ollama
Hi, just wanted to say how much I appreciate your work.

I'm curious if you have considered implementing Microsoft's Guidance (https://github.com/guidance-ai/guidance)? Their approach offers significant speed improvements, which I understand can sometimes be shortcoming of GBNF (e.g https://github.com/ggerganov/llama.cpp/issues/4218).