Most people's inner monologue does blurt out the first thing that gets into its head. The human brain has a bunch of different parts. And it's looking like one of them could be something like an LLM.
I love your enthusiasm in this direction (I really do).
But here's some free advice I won't be able to prove for a long time:
Anyone who is currently convinced that somehow our fledgling efforts in the direction of building useful ML models are somehow going to yield a new golden age of neuroscience and understanding of the brain-- rather than the other way around-- is gonna be in for a long and frustrating next couple of decades, especially if they're low-openness types.