The GPGPU developer experience has a long way to go

Very true, important and under-represented view.

And this is not even half of it. It's the dark ages, like cpu computing 50 years ago when computer vendors all had mutually incompatible, uniquely buggy sw stack fiefdoms, and tooling and commodification hadn't yet forced them to cooperate and converge.