Yes, you can't even turn them off by unplugging them, as it were. A certain kind of emergency shutdown dumps the helium needed to allow superconductivity (and thus maintain the magnetic field). It costs like $20,000 to do this and is quite dangerous in itself.