I sort of agree with you... The trouble is your logic is trivially obviously nonsense.

"Word calculator", "linear algebra"... This is just a variation on it's just a stochastic parrot / it's just a next token predictor.

The implication is that because it is "just" this simple-sounding thing, it can't be a complex thing! Except we know empirically that that doesn't hold. What are humans if not "just" next action predictors, "just" a collection of simple atoms, "just" electrical impulses? Yet clearly we are more than the sum of our parts. There no reason to believe dirty water can be more than the sum of its parts but weird sand can't.