One challenge/opportunity I've had is harnessing really wide running cheap agents. Any thoughts on how to move really cheap agents beyond basic summarization so we can go broader than the pricing of frontier llms allows?
So $1.5 for 40m tokens I guess would cost much more with sota (but would need less tokens perhaps).