Game Asset Storage, Loading, Compression and Caching
ph3at.github.io
ph3at.github.io
The actual implementation of that would be very difficult with current graphics APIs... I think. And it wouldn't be particularly useful in game that primarily store textures in GPU-friendly formats. But the upload to the GPU would be incredibly fast, and it wouldn't even steal any work from the shader units.
Over in ML land, Nvidia GPUs actually do have a beefy hardware JPEG decoder just for this scenario.