> I want to make sure that using your GPU is as easy as pie

For Nvidia they made the PGI compilers free with the HPC SDK: https://developer.nvidia.com/hpc-sdk