TensorFlow and PyTorch fit the bill, their underlying implementations are C++/CUDA/hand-optimized kernels and the APIs are all reachable without Python. They're kind of monsters to deal with in terms of scale, speed of change, weird build systems in the case of TF, but the code is there.