LLMs can be useful tools for conducting scientific research, in much the way that ordinary computer programs, or desk calculators, or slide rules are useful for conducting scientific research.

I meant that (insofar as I am aware) they are not useful as models that we can study to understand the nature of human intelligence.