What's the easy way here? Linking CUDA into your Rust binary?
This might be an relevant read: https://smolmachines.com/engineering/gpu-over-vsock
the connection I'm making is that both sit on the same interface: the CUDA driver api (module load, launch, memcpy).
the paper is about compiling kernels using safe rust instead of CUDA C++, what I did is reimplement the other side of it using rust for the calls from inside a VM get forwarded over vsock to the host driver via api-remoting.
Today I learn through GPU MODE & their discord: https://www.gpumode.com/events
I've only built toy kernels to experiment with supporting remoting CUDA workloads on smolvm: https://github.com/smol-machines/smolvm/blob/6dcb182d7fbc9f5...