This is interesting but would different architectures of GPUs play nicely? E.g. 3 AMD gpus and one NVIDIA gpu?
There is a bit of fiddling with drivers but it is possible to have one manufacturer working in compute only mode and other as graphics and compute.