Hacker News Reader

In the download script, it skips parts of the model (02 and 83); any ML people have ideas why you'd do that?

It appears the indexing for the model parts is deliberately not contiguous; the 03-82 range represents the main 80 transformer layers. https://github.com/yandex/YaLM-100B/blob/main/megatron_lm/me...

That makes sense, thanks for clearing it up!