I'm not worried in the same way because I think all such work automation is subject to Jevon's Paradox:
https://en.wikipedia.org/wiki/Jevons_paradoxWhat I've seen is that increased efficiencies have massively increased the amount of "things" being done by the same number of people.
As a random example, I'm dealing with a large government department on a semi regular basis as a consultant, so I get to see lots of parts of their business and in some ways I know them better than their own staff do.
It's madness. They have the same sized team of admins in charge of an exponentially growing set of business applications.
Decades ago large enterprises like this department would have had maybe 2-3 core applications, typically running on a mainframe. Then they'd have a few dozen peripheral applications in the sense that "email" counted as one of those apps!
Now? Their single sign on system has hundreds, and that's not including hundreds more non-SSO applications. They're almost certainly over a thousand if you count things like Google Maps (which they use heavily!) and the long tail of developer tools, system admin platforms, and whatnot.
In the past, people like me would have had a dedicated secretary. Now? I'm expected to not just manage my own calendar, but do my own project management, organise my own hotel rooms, and so forth.
It has become "so easy" that "anyone can do it", so everyone does. This just means that instead of one or two meetings a week, now we have many per day. Being able to organise a meeting doesn't mean that the same number of meetings have less organisation overhead. It means many more meetings.
Work hasn't be reduced. We're doing more of it than ever before...