Thought I'd mention jitsi (https://jitsi.org) since it seems to aim to do what you are wanting. I am not sure how many connections it practically supports currently though.
"Jitsi Videobridge does not mix the video channels into a composite video stream, but only relays the received video channels to all call participants."
There's also absolutely no usage of SDP Offer/Answer in Jitsi Videobridge