Wrote a small script to test how LLMs handle growing context sizes. It sends larger prompts step by step and measures slowdown or failure. Pretty rough but useful so far. Curious if others have ideas for improving it.
196 karma · joined October 28, 2010
- No one ever
* I live in the state but no where near the water. So I'm sure my taxes will be paying for this.