Not really, the dispatching between experts happen for every word and every layer, so you can't easily isolate distinct models.