It actually isn't all that surprising, we've hit similar bottlenecks where JPEG decompression on the iPhone ends up choking feeds that are scrolled through quickly.
We didn't go the route of caching the uncompressed data on disk, though, we just keep the images in a maintained in-memory cache.