Google has the most big pre-trained models while Alibaba has the largest

openbmb.github.io

4 pointsfishingboy2 comments

So the number of parameters metric here is the sum across all their models, right? There isn't yet a single model with 10 trillion parameters... right?

Yes, it is the sum of all models. But M6-10T (MoE) of Alibaba is a 10 trillion one.

Reply on news.ycombinator.com