Fame doesn’t enter it - the point is Karpathy has about as strong a claim as anyone to having “actually used LLMs for non trivial tasks”.
He is a researcher who understands neural networks and their architectures exceptionally well. That is all.
And that is precisely why he is more qualified on the subject than your average vibe coder!