> One big factor is it often comes down to which worker group has a stronger union

Exactly this. For reference see why there are still humans on cargo trains.