For the heavy lifting of the actual linear algebra computations, these tensor computation libraries typically use some variant of BLAS or eigen.