On my near-term todo list is to explore a particular crank physics theory of my own with AI... but not as a way to validate it, I know it's a crank theory that is far too simple to have been missed by pros in the relevant fields, but as a window into the literature and figure out what's wrong with it and thereby learn something. I will be framing it to the AI in pretty much precisely that way: Go get literature and reputable sources and talk through why this is already well known, probably well known to be a bad and wrong idea.
I still feel like not enough people are talking about this here on HN... AI has opened the scientific literature like never before. It's like being able to interrogate it and interview it as if it was a person, rather than just searching papers, for keywords you don't know, for lines of thought you've never heard of, in a sub-sub-sub-field you didn't even know existed, and failing before you even knew what it is you wanted. I've read more papers in the past 6 months than the past 10 years. Whatever opportunity you have to try this out, be it some question bothering you for the last 10 years, or a crank theory of your own to prove out against the literature, the foundation of some vibe-coded program informed by the literature rather than just vibing on the neural weights directly, or just asking something random about the studied effects of beavers on local ecosystems, you gotta try this. Prompt it specifically for "reputable sources and scientific papers", that helps a lot. It does not make you suddenly an expert in the field, but it does let you poke through the pile of literature far, far more effectively than you could hope to before.
And then don't forget to ask it why your summary is wrong or incomplete. Even if it doesn't convince you, you'll learn yet more.