That's the whole point of productivity gains... Either you're richer or you can work less or ideally both.
On the other hand, the sudden explosion of capital creation and exploitation that sparked the industrial revolution led to the creation of the first societies in which wealth and freedom were attainable by families not of noble birth.
“Growth is only good if widely shared” is a meme that has led to immiseration every time it is implemented. If capitalism has to own child labor, then redistributionists have to own the violent mass scale enslavement of the peasants under Mao/Stalin.
But if you choose to work less, you probably shouldn't be surprised that you're not achieving as much.