> in the '08 financial crisis ... could have easily been AIs optimizing trading strategies too

??? They were... There are books about the faults in the algorithms that led to the '08 financial crisis.

> pull the plug after it kills people

Are you aware that in this regard "AI" means "all algorithms employed in decision making"?