I'm curious how bad disabling this caching feature would be. Specifically, how often do you load the same image on two different domains?
I suspect you'll find this is _way_ more common than you expect.
(Also, if you thing Goog aren't doing this with their font CDN or various javascript library coaches, even (or especially) for sites without Google Analytics... I've got a bridge to sell you...)