I think this isn't quite the right example - a pocket calculator does not need you to verify its output. It is better to be able to calculate, but if you can't seems much less a issue then using a AI without being able to do whatever you asked of it
(So I fully agree with your point, but I think your example is not strong enough)