Here's also the Github: https://github.com/try-reason/reason
56 karma · joined September 25, 2023
If you need any help, feel free to contact me either on Github or in my email (inacio@hey.com).
The return value is not guaranteed to be correct. REASON uses function calling to force the model to return a valid JSON object; however, sometimes models hallucinate.
For OpenAI models that have JSON mode, REASON uses that instead.
However, it has an internal validation step where it checks the return value, and if it's not correct, it'll throw an error (this behavior can be disabled though).
Here's more info about it: https://docs.tryreason.dev/docs/essentials/reason#will-the-l...
Your suggestion to use logits is super interesting, though! And it sparked this line of thinking: since REASON uses function calling, it has been somewhat difficult to integrate with OSS models — however, if under-the-hood we use Jsonformer, that might be the missing key for incredible OSS model support (?). What do you think?
EDIT: if that also doesn't work, there is the documentation — which is where 99% of the info is: https://docs.tryreason.dev/
Yeah, adding audio to the video would help — I'll try do record something later today and update it.
When building LLM apps a good chunk of the workflow is testing new stuff and seeing what works or not, and one of the most useful features of RΞASON to me is that its OpenTEL compatible. Which allows for things for you to inspect your LLM at a close level with ease (see: https://docs.tryreason.dev/docs/essentials/observability#usi...).