That sounds awful and a big reason why I think GPUs will go the way of the dinosaur in the near future.
To summarize my gripe, it's is that the abstractions on GPUs seem broken, and we still don't have a good model for how to write high performance GPU code that just works and keeps getting faster as GPUs get faster.