Every time human labor is replaced by machines this question gets asked. So far, over many centuries, the answer has unequivocally been: over the long run, replacing humans with machines is incredibly good. The bad is short lived but real - people have to switch jobs, often for lower work because they are too old to amortize new skills training.
Short of skynet, I celebrate humans being supplanted.