HN
Hacker News
Top
New
Best
Ask
Show
Jobs
Comment by yorwba | Hacker News Reader
Parent
Full thread
yorwba
·
It's not the same KDA as used in Kimi Linear, though.
View on HN
GaggiX
·
What's the difference? They are both called Kimi Delta Attention.
yorwba
·
The differences are explained in section 2.1.1 of the Kimi K3 technical report:
https://arxiv.org/pdf/2607.24653#page=4
Reply on news.ycombinator.com