Wouldn't you need to in a real world scenario make the CUDA cores aware of the game geometry adding more work on the CPU?
And in most cases it's ok to spend time on one CPU function (creating and loading the BVH) against the hundred thousands of frames you'll be drawing on GPU.