Hacker News Reader

Hmm, no mention of Megatron in their timeline? https://nv-adlr.github.io/MegatronLM

They do mention the 8b+ "GPT-2" model trained by nVidia. Which is their reference to megatron.

Oh! You are right! How did I miss that..