Yeah but energy is still a cost, and local inference without batch and multiplexing for many users (like an office would be) is even less optimal.
I'm not sure I think it's just pushing the problem forward
Not even for the environmental aspects, just purely from energy demands, at any spot on the Earth where a data center could go.