Most likely a small retrieval optimized model with focus on JSON tokens and a combination of the technique involved in grammar/guidance
https://github.com/guidance-ai/guidance
Same principle
https://github.com/guidance-ai/guidance
Same principle
No comments yet.