For it to be able to use other agents it needs to understand when a problem requires deductive reasoning, and when probabilistic inference is appropriate. So that's just moving the goalpost. And of course in that case the intelligence and capacity is then in the system the task is outsourced to, so it still needs to be solved over there.
>I've never been hired on the basis of learning axiomatic rules.
Nope but you'd be fired really quickly if you couldn't communicate or follow some. I don't think you were trained to not throw coffee cups off the table like a cat via reinforcement, B.F. Skinner style. Which is really how we have to interact with these models (i.e. prompt 'engineering'). For humans to put artificial systems in task of really complex systems there needs to be a way to interact at a high level reliably and put boundaries (that is, rules) in place. As of today we largely have those outside of the models when necessary.