Progress happens as a result of many choices made by individuals to invest time and energy solving problems. Why is solar rapidly improving now? Because way more people are invested in making it better.
Nascent technologies almost always face an uphill battle because they compete against extremely optimized legacy technologies while themselves having no optimization at first. We only get to the current rapid period of growth because enough people pushed us through the early part of the S curve.