why would you need a local fable at that point? AGI will surely solve all the problems in the world at that point
I personally don't think the weight efficiency will improve that much; if anything big does happen, I expect it to be about scalable architectures and continual learning