Hacker News Reader

You don’t have to go to that level of detail but it is still relevant. For example FlashAttention is built on optimizing for this level of detail.

Any specifics you can describe or somewhere to read about this?

Just google Flash Attention 2, first hit is the paper.