Interesting - this is a different way of looking at it. Basically providing core capabilities that won’t change as platform so developers can focus on business logic. I do think this is valuable insight.
1 karma · joined March 21, 2018
> The metadata tokens is a string [1]... that doesn't seem right. Request/response tokens generally need to be separated, as they are usually priced separately.
For the metadata you are right. Request and response tokens are billed separately and should be captured accordingly. I've put a PR to address that [2]
> It doesn't specify how the messages have to be arranged, if at all. But some providers force system/user/assistant/user... with user last. ...
We do assume that last message in the array to be from user. But we are not forcing it at the moment.
[1] https://github.com/open-llm-initiative/open-message-format/p...
[2] https://github.com/open-llm-initiative/open-message-format/p...