Gemini 1.5 Model Family: Technical Report [pdf]

Wow! This is pretty cool.

> With only instructional materials (a 500-page reference grammar, a dictionary, and ≈ 400 extra parallel sentences) all provided in context, Gemini 1.5 Pro and Gemini 1.5 Flash are capable of learning to translate from English to Kalamang— a Papuan language with fewer than 200 speakers and therefore almost no online presence—with quality similar to a person who learned from the same materials. Moreover, we add in 45 minutes of transcribed Kalamang speech recordings to demonstrate that Gemini 1.5, for the first time with an LLM, can leverage mixed-modal documentation to learn speech recognition for a new language in context.

Wow. Contains many examples of success and incorrect deductions, and statistics representing success rates.

A really long document.

I've been wondering what are the good papers about long context-related research. They listed a handful of papers about that on page 9. Is this a good reading list? They don't say this is what they do.