I recently did a livestream on trying to understand attention mechanism (K, Q, V) in LLM.
I think it went pretty well (was able to understand most of the logic and maths), and I touched on some of these terms.
I think it went pretty well (was able to understand most of the logic and maths), and I touched on some of these terms.