The only real difference between then and now is that OpenAI's models are significantly better than my models from 2015, and they have that because well, they can afford to pile on more data. TBH, I never even considered using a large proportion of the whole internet as a training set as even remotely possible due to the sheer mind boggling costs.
Even now, to go through about 10% of The Pile would cost me way too much money.
THIS part of the AI sector is just a giant pyramid scheme - impress the investors so they shovel trillions your way. That's not exactly new in Silicon Valley - keep the valuation of a hot potato going up until someone is left holding the bag.
AI's most useful applications are not being a generalist.