If you really measure what is being run, it is more likely well-optimized CUDA GPU assembly kernels - or, at this point - might be already some exotic TPU-like accelerator assembly.

This hubris over the top-level language in the system is so passe, so 2000s.

at this scale, the ml models are usually compiled into a format that runs independent of python. so the answer isn't "python"