The ML models will be trained as long as we as the human society in charge allow them to be trained. Progress only happens if society allows it to happen. The commercial AI proponents are trying to do an end-run around societal adjustments, forcing change at a speed that is to fast for proper responses. It could be interpreted as a malicious attack. We, the people, could collectively decide to slow them down or to make them stop. Their hope is to confront us with a done deal before any opposition has found the resolve and organization to do anything meaningful about it.
We, collectively, need to decide where to draw the lines on this technology and we need to decide fast.