True, but maybe they can use 50% less power or something. Maybe 90% if we're really lucky.
But the growth in the scope and usage of AI is poised to grow exponentially, assuming this isn't a bubble.
But the growth in the scope and usage of AI is poised to grow exponentially, assuming this isn't a bubble.
After all GPUs were not really designed with AI efficiency in mind, and current AI architecture was not really designed with efficiency in mind, so there's probably some things that can be done. Over 5-10 years, who knows how much more efficient things could get?