We first tried to find some sort of map-library based solution that converted the images into a set of tiles, but eventually I found Viewnior which somehow seemed to be able to handle the pngs relatively well compared to any of the other image viewers we tried at the time (which all would choke on the giant sized images)
https://github.com/hellosiyan/Viewnior
I know that that's a very niche use case, and I have no idea how Qimgv compares ("fast" is not the same as "scales well with really large images"), but I thought I'd share in case anyone else has had to deal with this problem.