That might be the case, but these tools are marketed as having close to superhuman intelligence, with the strong implication that AGI is right around the corner. It's obvious that engineering work is required to get them to perform certain tasks, which is what the agentic trend is about. What's not so obvious is the fact that getting them to generate correct output requires some special skills or tricks. If these tools were truly intelligent and capable of reasoning, surely they would be able to inform human users when they lack contextual information instead of confidently generating garbage, and their success rate would be greater than 35%[1].
The idea that fixing this is just a matter of providing better training and contextual data, more compute or plumbing, is deeply flawed.
[1]: https://www.theregister.com/2025/06/29/ai_agents_fail_a_lot/