The fact that most of these folks are going to fail doesn't especially bother me. After all, that was true for previous generations as well. What's different now is that a lot of these folks not only won't be coming away from these experiences having developed marketable skills, but many of them will have significant health problems that prevent them from doing so in the future.
I'm actually very bullish on the use of AI in software development overall. But when placed in the hands of folks who haven't yet had the time to develop hard skills, it both enables and incentivizes cutting corners to an alarming extent.