Hacker News Reader

Note that the FLAN-T5 variant in 10th place is 3B parameters large, there is another FLAN-T5 variant that has 11B parameters that should perform better (and the fact that a 3B model is able to compete with Alpaca-13B is impressive by itself).

What you're missing is not reflected on the leaderboard right now, Guanaco 65B.

Guanaco is LLaMA tune and thus is irrelevant for commercial use, isn't it?

Ah true! It isn't for commercial use.

I'd say your missing the importance of not being bound to a proprietary model, and of not having to explain to your customers why you send their data to a third party. It's still early days - definitely if you need the sota performance this second, you don't have any options. But in the fairly near term, I see no evidence that the proprietary generic models will keep their leads in a way that's meaningful for commercial products. Do you?