Yeah, I know, “don’t believe what you read on the Internet” — but that’s other people on the Internet.
People are used to computers themselves being deterministic, reliable.
Those are basic skills humans in those positions should be able to do.
From the headline I thought the AI mixed some food-ingredients to make chlorine gas, which would be really bad. But if one were to only input "battery acid, cut fingernails, hairball, dead smartwatch" what kind of recipe do you think they'll get?
I'm just saying that there's a learning curve, like with all new technologies, and that a population-wide sense of "trust this a little, but not too much" will probably take some time to propagate.
I'm afraid I have bad news for you: https://en.wikipedia.org/wiki/Miracle_Mineral_Supplement
I really doubt we did. People seem prone to assume the computer is trustworthy since the very beginning (maybe extending it from calculators?) and blatantly refuse to question this assumption.
The general assertion of computers' trustworthiness has been causing problems due to bad data or bad algorithms for decades already, there are entire movies about it, and almost everybody has had problem with it already.