A few of their techniques will MASSIVELY reduce the cost per kwh of battery storage. They already have around $100/kwh tech and they are looking at reducing it to ~$50/kwh. Their big issue today is scaling. It's not that the batteries aren't cheap, it's that they simply can't make enough of them (they are scarce).
Tesla is way ahead of the curve when it comes to battery manufacturing, they have to be for their EVs. They are about to amp that up even further.