Surprisingly, there exist people doing GPU programming outside of ML. I work in high performance computing and lots of people write CUDA code.