I ask you - Why does the entire grid need to be rebuilt for batteries? Australia needs to split generation and transmission/distribution apart - the utilities shouldn't be able to make money of their own generating assets similar to a majority of US jurisdictions.
I'll counter that I believe the energy systems are moving in the right direction and will likely get to a better spot over the next 5-20 years as the infrastructure upgrades are necessitated and alternatives products that are more cost-effective options become more viable / pressure builds on policy makers.
And yes, energy markets are incredibly complex - especially in highly dynamic areas with fluctuating demands and supply possibilities. I believe the CA-ISO was integrating electricity for 10,000-35,000 MW every 3 seconds about 7 years ago -- probably way faster at this point. It's amazing and humbling what our grids operators are able to do.