Latency issues and mix of incompatible hardware sounds like some pretty poor planning / an inexperienced team?
Will the renters experience the same issues?
Elon said it was "built wrong" without giving details. Every AI company has a mix of different GPUs but they probably don't try to combine them in a single training run.