Hacker News Reader

It's so bizarre having a low score be GOOD. It's like reverse intuition. Shouldn't it be called `score error` or something along those lines?

Great point. I've changed the naming.

Since it has low activated parameter count but huge total parameter count it needs more tokens to move the relevant information into the context.

Thanks for the help. I ran it on high and it did pretty well and got a lot of one-shots in. The reasoning makes a much bigger difference than some other models.

Does it move the needle on high reasoning?

Yes. I've just run it on high and it did a lot better.

A colleague of mine has a strategy game to compare language models, 4.1 scores pretty high in this:

https://clankerbattle.com/