The product page suggests that this sort of GPU can handle streaming 8k video. So maybe the card was designed for OpenCL accelerated video editing or some other 3d-task (maybe 3d rendering) with very large texture data.
The ability to work on full res 4k/8k video (in realtime) without generating down-scaled proxies will be a huge time-saver for editors in addition to saving money during post.
On Nvidia if you want this, I think you can basically achieve it using GPUDirect anyway if you really want to bypass CPU transfers and go straight from SSD to GPU, via PCIe. I guess it depends exactly on how this card is connected to the disk.
Having it on-card is pretty convenient, though. GPUDirect has practical limitations on what boards/systems it will work with.