Of course, the trouble is, sometimes the new thing is just bad. A commuter/metro train system in my city operates mostly on 40 year old rolling stock. In 2000, some new trainsets were introduced, from two different manufacturers. One model never really worked properly, and was scrapped in 2008; the other survived. The whole thing is now due to be replaced with shiny new trains, starting this year... hopefully these ones work.
You'd _think_ this wouldn't happen, because reliability is absolutely the number one thing that operators care about, and they're usually willing to pay a premium to get it (the alternative being to pay to keep their reliable 40 year old units in service). But the industry's surprisingly bad at delivering it.