This oversells the paper quite a bit, the interactions are rather mundane as the authors note (and I'm rushing to implement it! it's awesome! but not all this)
The trick is they’re all just permutations on manipulating what’s in context + embeddings for memory + prompt engineering.
There’s new things here! I’m rushing to implement the 2D visualization part! But this simply isn’t ground-breaking