NVIDIA confirms Blackwell support for OCP microscaling formats MXFP8, MXFP4

From the article:

"NVIDIA Blackwell introduces revolutionary block-scaled floating point formats, including the Open Computing Project’s microscaling formats, which Triton now unlocks for NVIDIA Blackwell-powered hardware acceleration.

These formats provide higher average precision at higher performance than the non-native block-scaling techniques emulated frequently in LLM inference projects today.

For OCP format support, MXFP8 GEMMs on Triton showcase exceptional performance similar to the FP8 GEMMs performance accelerated and shown earlier in this post, while natively allowing for scaling in the Tensor Core.

Similarly, MXFP4 provides a new operating point in the precision-performance trade-off space but while offering double the hardware-accelerated performance of FP8 and MXFP8 GEMMs.

While Triton performance for MXFP8 is close to the NVIDIA Blackwell-accelerated FP8 shown earlier, we continue working with the community to accelerate and enable new use cases around block-scaling support."