sagemath is such a distribution, but also a rather thick layer of algorithms on top of that. many of them are actually written in cython, to make them fast and to have a good binding with those libraries, etc.
Also a syntax pre-parser to support more "standard" mathematical notation (one among the many: exponentiation using ^)