How is this significantly different from n-1 streams coming from a single peer/server connection? Isn't that simply what it takes to have a group video call?
At least scaling could be done server side (welln not in a E2E scenario) based on the receiver viewport to reduce bandwidth.