The Bath County Pumped hydro station stores about 35-40 GWh of power (35,000 MWh), cost $1.6 billion in 1977-1985 or so (so inflation-adjusted about $100-150/kWh).
Compare to the largest ever battery storage project, the Tesla 129MWh installation in Australia is "guaranteed" for $250/kWh, but that doesn't include a lot of extras (the storage facility has a pretty high discharge rate, able to dump its storage in roughly 1.3 hours vs like 4-8 hours for better battery life and lower secondary costs).
So in terms of cost and scale, pumped storage steal beats the best battery installation by a factor of 2 (not counting likely longer service life before replacement, although that depends strongly on how hard you cycle the lithium batteries), and scale-wise beats it by a crazy factor of 300.
Pumped hydro does have some geographical constraints, but there's a lot more opportunity to build them than many detractors suggest. (Obviously, the sweetest places to build them are by definition limited, but you can also build pumped hydro with a very low head, like on some of the Great Lakes projects, or with a very large head requiring very little water.... you don't need a nice canyon feature for pumped storage, a big round concrete reservoir on top of a hill works just fine, too. And with enough volume of water, you don't even need a hill.)
And I say this as a firm believer in the potential (heh) of the lithium battery and in Elon Musk. Pumped hydro should not be ignored.