Hacker News Reader

> The Gemma 3 models are multimodal—processing text and images—and feature a 128K context window with support for over 140 languages.

I'm curious as a multilingual person: would a single language (english/spanish/cantonese) allow for the model to be bigger and still fit in a single GPU?

View on HN

In the context of another multilingual model I've heard that the majority of its training was in mainly one language, as that training seems to be applicable to languages added later too. To me that sounds plausible given adding a new language would mean vocabulary & grammar while the understanding of concepts should already be there.

Intuitively adding 140 languages instead of e.g. the 5 most common would otherwise be in conflict with making a small model that fits a single GPU.

Reply on news.ycombinator.com