ParentFull threadkzrdude·We don’t know but I think we assume that it is MoE or some almost equivalent sparse activation technology.View on HN