What type of utility scale storage isn't a battery? The answer is, of course: any energy storage setup is a battery[1].
A more generous interpretation of your comment is that you meant won't be chemical batteries.
In which case, I'll bite: what then?
1. Energy storage is the capture of energy produced at one time for use at a later time[1] to reduce imbalances between energy demand and energy production. A device that stores energy is generally called an accumulator or battery.
However this is of course not enough to run industries with high electricity demand, what people tend to forget is that one factory (like melting of aluminum) can consume more electricity in one day than an entire city in a year. For that you need nuclear power or hydro.
The remaining problem is building factories for electrolysis equipment. Building factories takes an appallingly long time. But the problem is only of time, not technical maturity.
There are few countries with better opportunities for renewables than Sweden.
Nuclear power is a good idea, but so is wind for Sweden. We already have a lot of wind but high pressure areas with little wind do exist, even in winter. Nuclear looks kind of good from that point of view, but I strongly feel that Sweden is way too small of an actor to buy reactors on her own, and should actually co-order reactors with other countries, getting the costs down (maybe not even costs, but risks. There have been a lots of bankrupted players in nuclear lately).