AWS isn't a utility because utilities sell commodities for which you can switch to a competitor easily, as you're buying the same thing. There are companies selling similar products to AWS but none that sell AWS itself.
Also, I doubt anyone was referring to electricity as a commodity in the early days before the industry developed standards.