Isn't that sort of how GPT-4 already works? It's a Mixture of Experts architecture that bundles together a bunch of models and selects one for each query.
do you have a source for that info? (not accusing, i've heard this before, i just want to see it from openai) i'm curious because i believed that myself but i'm not sure how some of the developments from this release would work in that architecture