What are you doing that cannot benefit from a larger context window? Just having a long conversation with chatgpt can benefit from this.
That's true as long as it's free. API users will still want to optimize for cost.
Probably for a lot of uses but there are plenty who optimize for value and the cost does not matter. Unanswered question since 32k does not exist in the API. Does a longer context improve summarization? Can we use it for chain of thought or other workflows that can benefit with a longer context?
create a sentient being that learns from its experiences so I don't have to keep setting it up with the same prompts over and over, and so I can manufacture "friends".