IBM and NVidia do have CUDA JVM support.
There are .NET CUDA implementations as well.
There are .NET CUDA implementations as well.
For example, on Android, Java is the name of the game, beyond 3D rendering and audio codecs, the NDK is quite useless as everything else is exposed behind JNI calls.