> just keep asking it questions and maybe its reasoning would check out for most of them.
But the AI isn't reasoning... is it? Perhaps it could give an explanation, but you couldn't (currently) conflate that with any actual understanding of why it did what it did?