Distributed large model training with web clients?
With 10Tb/s Internet, then sure!
Well the bigger issue is that even natively I doubt there is enough performance to train anything interesting.
WebGPU don't have access to most accelerators in GPU so it would be super slow compared to CUDNN version but pure CUDA would be only x times times faster.