Definitely not a typo.

Also:

> # vl2-tiny, 3.37B-MoE in total, activated 1B, can be run on a single GPU < 40GB