Hacker News Reader

This is amazing, thanks for sharing. I'm implementing some of these techniques myself right now, but being able to try out different algorithms and having plugins etc available immediately is really cool! Can't wait to try it out.

How are you dealing with structured outputs?

View on HN

>How are you dealing with structured outputs?

The models have gotten much better at generating them with just the prompt. I have not implemented strict support for structured output or JSON generation yet. The response from the proxy are all raw text responses.

One way would be to just apply outlines or some library as a plugin to enable structured outputs.

Reply on news.ycombinator.com