Humbly, have you used excavators of varying sizes on uneven ground? I have and would suggest it's more important than you might think. But if you've operated them, you might know better than I.
Also, teleoperation is likely to produce lower-quality operation data than hooking up to locally operated excavators. Just a thought.