It's artificial intelligence. If you treat something like a person and delegate to it, how can you later say you didn't trust it would execute your commands faithfully? And how wouldn't you be negligent in delegating a task to new, unproven tech?
If companies are spending so many resources on "alignment" can they argue that they didn't know the risks of their research?