As we see these systems evolving, I have come to believe specialist small language models with an MoE framework are the future of the industry.