nah this doesn't explain it.
most of the users of those third party harnesses care just as much about hitting cache and getting more usage.
most of the users of those third party harnesses care just as much about hitting cache and getting more usage.
He demonstrates in the code that OpenCode aggressively trims context, by compacting on every turn, and pruning all tool calls from the context that occurred more than 40,000 tokens ago. Seems like it could be a good strategy to squeeze more out of the context window - but by editing the oldest context, it breaks the prompt cache for the entire conversation. There is effectively no caching happening at all.