AI is software.

As software gets more reliable, people come to trust it.

Software still has bugs, the trust means those bugs still get people killed.

That was true with things we wouldn't call AI any more, and still does with things we do.

Doesn't need to take over or anything when humans are literally asleep at the wheel because they mistakenly think the AI can drive the car for them.

Heck, even for building codes and health & safety rules, they're written in blood. Why would AI be the exception?