HNHacker News
TopNewBestAskShowJobs

rohanmehta1

9 karma · joined September 18, 2023

submissionscomments
rohanmehta1··on New tools for building agents
Not yet, but it's on the roadmap!
rohanmehta1··on Ask HN: Do LLMs get "better" with more processing power and or time per request?
> But this is because larger models tend to be better, not because throwing more compute at an existing model helps it produce better results.

There's a caveat here - allowing the model to produce more tokens (i.e. giving it more compute time to "think") can produce better results. E.g. asking a model to reason before producing an answer, leads to better answers. And the extra tokens = more compute.