I believe that chips will get more efficient as they get tuned towards AI needs. Also, energy costs will continue to fall as they have for thousands of years. Think about this, at one time we would have to put a lot of wood or animal matter to get enough energy for a few hours of light at night. Now it takes very few resources to get enough light for a whole night. It's so relatively inexpensive that we can light an area all night without having to think twice about the cost.
Energy will get so inexpensive in a few years (10?) from now that power consumption by AI will not be a problem.