Okay, but how would I write evals for my project's agents file? Any good examples out there?
You can learn about them evaluating that site https://github.com/Alexhans/eval-ception and then the pattern should be easy to test on your own thing.
What do you think would resonate with you or with the audience you're thinking about?
That repo also has an illustrative eval for Agent Skill in Airflow for Localization
https://github.com/Alexhans/eval-ception/tree/main/exams/air...
The question I have is: what are we optimizing for and how do we measure it?
In your own repos, I see you have a fork of safepass, which seems like a nice simple project, but it doesn't have an agents file yet.
It's agents all the way down!
Submit a GitHub repo containing skills to Tessl, and it will generate the evals, run them, and present the results. https://tessl.io/registry/skills/submit
The evals and results are all shown, no login necessary, so you can assess them yourself. e.g. https://tessl.io/registry/skills/github/coreyhaines31/market... (click details to see the eval texts).