Ask HN: Is anyone giving out tokens for benchmarking LLMs?

3 pointsemosenkis1 comment

I'm thinking of benchmarking different models performance playing Nethack and learning the game under different constraints.

LMarena, now https://arena.ai. Not sure if they have API access to automate it though.