ParentFull threadTonyStr·Very interesting. Is this compatible with MoE architectures? I'm not too familiar with how this works.View on HN