Until airlines cease to need a scapegoat, they will keep pilots in the cockpit.
There are statistically an enormous number of ground movements carried out safely but boy does the potential body count get big with runway incursion scenarios. Two 757s colliding is a lot of people, and in high-energy scenarios at least one of the aircraft isn’t walking away. You can be doing nothing wrong and someone just landings on your taxiway etc. The close calls are terrifying.