Pumped hydro is fantastically expensive, not all that efficient, and only works with extremely specific (and rare, aiui) geography. It also comes with the same ecological disasters as dams, displacing entire ecosystems or towns and producing a ton of methane emissions from the now-submerged and decaying plant life.
There's no such thing as a free lunch.