"A computer system cannot be held criminally responsible, so we must delegate all decisions and actions to it"
Now, there are certain crimes where mere recklessness or even negligence is sufficient to convict — e.g. criminally negligent homicide, negligent driving, etc. But, those are exceptions to the general rule of criminal law, either domain-specific or justified by the severity of the consequence (someone died). Thus far, AI agents haven’t gone there.
If we eventually get to the point that AI agents start unintentionally killing people, then you could prosecute their operators for criminal negligence.