https://en.wikipedia.org/wiki/Pumped-storage_hydroelectricit...
Flywheels are also used for short term demand spikes. https://en.wikipedia.org/wiki/Flywheel_energy_storage
PS: This is one of those problems that seems a lot more important than it actually is. The current state of the art is fairly cheap and reasonably efficient. Going from 90% to 99% efficiency really does not change much and is a far harder problem.