See Halide, a latency-hiding scheduler/compiler for GPUs and CPUs...

Halide: a language for fast, portable computation on images and tensors http://halide-lang.org/