There's someone I know that jumped head-first into AI... they have embraced everything agentic. While setting up mail on their new iphone they encountered a problem. They had claude go through and do a bunch of tests against the server... allegedly. It didn't do any actual testing, though it did generate a long-winded report of what it pretended to try, fully blaming the server the whole time.
Actual problem: he typed in the wrong password