I would guess max_tokens refers to the number of generated tokens, not the size of the context window. That at least is the meaning of max_tokens in the ChatGPT API.
https://platform.openai.com/docs/api-reference/chat/create#c...
https://platform.openai.com/docs/api-reference/chat/create#c...
No comments yet.