Doctors, bankers and lawyers are screwed as well. ML will make sure of that. We will still need some people to perform those functions, but not nearly as many as we have now.
Something that seems to get missed a bunch when talking about the upcoming lack of work for humans is that a job category doesn't need to be fully automated to cause widespread lack of employment.
Simply automating a job enough to allow 2 people to do the work 3 used to do puts 33% of those doing that job out of work. 33% unemployment is already an economic nightmare and the actual ratios of "X people to do the work Y used to do" will quickly become much more severe than 2 to 3.
Some people will inevitably say "this has happened before", but this time a lot of the automation is going to be purely software. You are not going to have enough new jobs for people "maintaining the robots" at anywhere near the scale required to make up for the lost jobs like you did with the previous more mechanical style of automation.
Your mistake is assuming that a sizable portion of the work these jobs involve can't be replaced by "dumb AI", which is what ML is all about, and that they require a fully general AGI.
If the proposition is that this would lead to fewer humans being needed for these jobs, I suppose that could be the case. In my own field, my criticism of automating, say, legal research and writing, is that the time it would take for me to check the work would be nearly the same as doing it myself. I don't see much efficiency gain, which is why I think the only thing that would truly be better than a human would be an AGI.
Also, if you look at most of what's been automated away, there's very little what we would consider (and even what people 40 years ago would have considered) artificial intelligence involved.
If you look at the legal field, what's changed is the means of gathering and disseminating information. Legal researchers can be much more productive with computer searches, and consumers can get access to advice and forms in some cases without the need of direct face time with a lawyer.
Some of the changes weren't even primarily driven by technology at all, but by new ideas for business models. I think that something like legalzoom could have been done with the technology available decades ago (phones, mail, and catalogs).