Glut still costs $$$$ to run, electricity isn't cheap at that scale.
It's a different order of magnitude, though. Buying an H200 GPU costs upward of $30,000. The electricity cost to run it at full power for a year would only cost me $675 (700 watt TDP, 11 cents per kilowatt hour at my house.)
Everyone having their own private multimodal assistant on the cheap will be pretty futuristic if we can make it happen