Instead of fixing the horrible JPEG encoding can you please add support for webp? It's quite a bit smaller and well supported with polyfills since it's just a single vp8 frame
They are typically pushed by people who use the latest chrome, so they have an excuse not to care about other browsers.
Their preformance, and usability is almost invariably terrible.