Remote driving, though, might solve for this. You still have a human to react to unforeseen circumstances, but you can switch up the remote driver easily so you can work in shifts, drive 24/7, not stop for bathrooms/food etc.
I'd imagine the quality of life would be significantly better too since they would work in the same spot with co-workers and could go home every day.