Rules of using AI:
#1: Never use AI to think for you
#2: Never use AI to do atomonous work
That leaves using them as knowledge assistants. In time, that will be realized as their only safe application. Safe to the user's minds, and safe to the user's environment. They are idiot savants, after all, having them do atomonous work is short sighted.
The latter may be cheaper, sure. But too cheap can become very expensive quickly.
And their customers won't care either way it seems
Or if they do care they won't have any real ability to do anything about it anyways
For physical things that has early limitations, but not for software. I would be very confused to see an AI stress test that did not end in failure, and would always question the test instead of thinking "wow, that must mean the thing is ready for autonomous action!"
We have a non-insignificant amount of people doing the #1 already, and the amount of people doing the #2 is only going to increase as more and more AIs are designed to be good at autonomous agentic behavior specifically.
The ship has long sailed on "just never let AIs do anything dangerous". If that was your game plan on AI safety, you need a new plan.
> having them do atomonous work is short sighted
I also think they shouldn’t be doing atomonous work. Maybe autonomous work, but never atomonous.