You're assuming that in the first example, they'd be unemployed. Instead, they're freed up to do new initiatives that generate new wealth that would not exist in the second scenario.
More activities across the same labor pool makes more wealth in a society than fewer activities which consume all available resources. This is why we're much richer now that 70% of workers aren't farmers.