Not just Nvidia: GPU programming that runs everywhere
pythonspeed.com
pythonspeed.com
In general, though, as I understand it (not a GPU programmer) you want to pass data to the GPU, have it do a lot of operations, and only then pass it back. Doing one tiny operation isn't worth it.