The roofline chart on page 63 has some problems. The X and Y axis are not labeled with units such as "FLOP/byte." Also, proper roofline charts don't have the dashed line that the chart on page 63 has - they have a only flat line on the right part of the graph and that is why they are called a "roofline chart" - see the examples in the paper:
https://arxiv.org/pdf/2506.05871 . I'm a bit confused also about why that roofline chart does not show the effects of different levels of quantization on the roofline max thruput, which would successively climb the performance axis to higher levels as you went from FP16 to INT8 to INT4. Also, I don't really follow the discussion on page 64 and following pages as it doesn't discuss the affects of quantization on max thruput as it appears that the paper cited on page 64 was before the use of quantization really took off?