HNHacker News
TopNewBestAskShowJobs

testdfkjahdfh

4 karma · joined October 8, 2024

submissionscomments
testdfkjahdfh··on Differential Transformer
if two attentions A, B are identical, would (A - lambda * B) be just (1-lambda) * A, how does it "boost the signal value(s) over the "noise""?