You don't even need a constrained decoding.
As a closed source chat-API provider, you just need to find a way speak JSON correctly at API output.
As a closed source chat-API provider, you just need to find a way speak JSON correctly at API output.
No comments yet.