It's not continuously evolving outside the developer's control, right? Companies need to checkpoint dependencies for resilience. Can you define tests to ensure compliance of new versions?
As long as we don't ask it to make paperclips it should be fine.
No, we plan to implement governance firmware, versioning, and test checkpoints to prevent runaways and maintain safety/compliance.
I hope this causes a catastrophe somewhere. This might be the warning shot that humanity needs to wake up, before we hook up spiking neuromorphic hardware to run agents.