HNHacker News
TopNewBestAskShowJobs

hh1

1 karma · joined May 9, 2024

submissionscomments
hh1··on xLSTM: Extended Long Short-Term Memory
When you talk about "c" or "scalar memory" in the paper, does that refer to a single unit in the vector usually referred to as c?

So in mLSTM, each unit of the vector c is now a matrix (so a 3d tensor)? And we refer to each matrix as a head?

Having a bit of issue understanding this fundamental part