Well, yes, but to be honest that code still has to be annotated with bounds and batch sizes etc. In futhark you need to know absolutely zero about GPUs
One of Julia's benefits is that the compiler is hackable so high level abstractions can be experimented with in user space.