I agree using both a high level and a low level language is normal, and yes using libraries is fine.
It's having both Triton and HIP in the same project which I find weird. It feels very fragmented to me to use two high level languages. Maybe it makes sense given Triton is easier to use but less fully featured, but it definitely didn't strike me as normal.
I would be interested to know if NVIDIA use more than CUDA and PTX/SASS to write CUDNN and CUBLAS.