CUDA is great for big dense matrices, which is incredibly important. But there is a lot more to scientific computing than big dense matrices.
Also, CUDA is low-level a library by one vendor for one class of hardware. Not a language. Languages serious about scientific computing already have multiple interfaces for CUDA at various level of abstraction.