I think server side processing is really not a good idea for this. Zoom is really seeing a lot of use right now. It would not be sustainable for them to not take advantage of all the computing power of the clients.
The Zoom client also requires minimal hardware requirements from the processor iirc.