Yes, you can think of this as a collection of small models, with another model choosing which smaller model to use for each input.