And never mind that the whole premise of this article is simply wrong. Look at the things GenAI systems are doing today and it's clear that they are more than just "parrots" stochastic or otherwise. Not even looking at the Navier-Stokes thing, but there are Youtube videos out there of PhD candidates in math who have tried out various models from a "can this help me with research level mathematics?" perspective multiple times, and quite often the answer is at least a qualified "yes". Does it really make sense to say that a stochastic approximation of "very average" content can be helpful in doing research level mathematics? I'm thinking "no".
My own anecdotal experience also suggests that whatever LLM's do, it amounts to more than being a mere parrot. ChatGPT was incredibly helpful to me over the weekend, for example, getting started on some neuromorphic computing stuff I wanted to do. It was amazingly helpful at debugging circuit problems, helping me setup some LXI/SCPI automation of my test equipment, doing literature reviews, yadda, yadda, yadda. Even better, unlike most human interlocutors I might want to interact with, it is fine with my weird "night owl" hours, happily debugging circuits at 2:00am, 3:00am, and on into the early morning hours. It never gets tired, never belittles me, tolerates my repeated questions, etc.
I get that some people are "anti-AI" for their own reasons, but I hope some of those people will at least stop and try to understand why some of us think modern GenAI systems are about the best thing since sliced bread. shrug