How do you deal with context length degradation here?
The harder questions will only arrive when the context is getting full.
The harder questions will only arrive when the context is getting full.
If it's something actually novel, no matter how much context you provide it'll still hallucinate.