HN
Hacker News
Top
New
Best
Ask
Show
Jobs
Comment by gyudin | Hacker News Reader
Full thread
gyudin
·
Super weird benchmarks
View on HN
avereveard
·
from what I gather it's finetuned to use OpenHand specifically so shows value on thsoe benchmark that target a whole system as a blackbox (i.e. agent + llm) more than directly target the llm input/outputs
amarcheschi
·
Yup the 1st comment says this
https://www.reddit.com/r/LocalLLaMA/comments/1kryybf/mistral...
Reply on news.ycombinator.com