This is also where MoE shines with a mixture of small and large language models.