"There is the factor that a lot of the code scientists write is hacky, one-off, and fragile"

Oh, absolutely. But the same goes for expensive, commercial software, too. In all walks of life, not just scientific software.