You cannot achieve true E2E encryption on Firefox as it doesn't support insertable streams, so I guess this is where the limitation is.
EDIT: bug on bugzilla https://bugzilla.mozilla.org/show_bug.cgi?id=1631263
EDIT: bug on bugzilla https://bugzilla.mozilla.org/show_bug.cgi?id=1631263
https://webrtcglossary.com/sfu/
https://stackoverflow.com/questions/60013467/one-to-many-liv...
Encryption keys are distributed out of band of the media, so it's the same as whatever the tradeoffs are for multi-party E2E-encrypted text chat there (I don't know what those are though!)
https://support.zoom.us/hc/en-us/articles/360048660871-End-t...
More details: https://webrtchacks.com/zoom-avoids-using-webrtc/