I would rather say, that the language is just a vehicle and especially beginners identify themselves too much with their preferred language, while more advanced programmer think more in terms of concepts.
You can solve most of the problems with any of the existing languages. Every language has its strengths and weaknesses, but I would say this pretty much balances out, the more different problems you try to solve with a language.
I agree for the present, because of (among other things) the degree to which modern programming languages contain explicit references to particular hardware limitations and problems. The fact that resources are drawn from stack, heap and mechanical storage device, and the existence of rules for choosing which is appropriate, only tells us how primitive modern languages are.
Mathematics might stand as a counterexample (of a universal language) if it were easier to use for programming -- but that problem is being addressed, and computer languages become more like mathematics as time passes.
> There is a fairly common core of mathematical syntax, but beyond that different branches will use their own syntax.
The fact that mathematics has many divisions isn't a counterargument unless mathematicians use different notations to refer to the same things. Apart from notoriously overused Greek letters, notations are unique and independent.
Spoken languages have many distinct vocabularies to serve the needs of specialists, but this doesn't undermine the usefulness of the language as a general tool. Same with mathematics.