GPUStack doesn't seem to have the problem of lowest common denominator but supports many architectures.

https://github.com/gpustack/gpustack