Just tested and it doesn't work out of the box on the consumer 50 series ie. 5080:
Testing GEMM:
Assertion failed:
deep_gemm/jit/../include/deep_gemm/fp8_gemm.cuh:369, condition: cudaFuncSetAttribute(kernel,
cudaFuncAttributeMaxDynamicSharedMemorySize, smem_size) == cudaSuccess
terminate called after throwing an instance of
'AssertionException'
what(): Assertion failed: cudaFuncSetAttribute(kernel, cudaFuncAttributeMaxDynamicSharedMemorySize, smem_size) == cudaSuccess