Pretty interesting. Using nightly + cu121 im getting 8.18 it/s, another 5% improvement vs 7.78 that cu118 gave.
88 karma · joined October 17, 2017
Bumping to cuda12.2 with pytorch2.0.1+cu118 made my SDXL go 50% faster and ESRGAN 80% faster on the 4090.
Make some images here https://explorer.gpux.ai/inference/gpux/karlo
if nvfruc is better quality + faster then the comparison is that nvfruc is better.
https://docs.nvidia.com/video-technologies/optical-flow-sdk/...