I actually believe the amount of $ is what was missing for them to improve their fundamental flaws. They're a very competent team, but were working with a tiny fraction of the budget of US/China teams.
But they're not competing (offically at least) for GPUs and they have much, much cheaper electricity (which makes pre-training more affordable).