If the demonstrated speed ups translate to real world performance, then I’m truly blown away. Looks like Nvidia will be holding onto the AI crown a while longer.

The only thing I wonder is how difficult is it to take advantage of some of the new arch features, such as TF32 format or sparsity tensor ops.