Interestingly, there is some neuroscience research that transformer architecture resembles "cue based retrieval" in the human brain in some important ways.

https://www.sciencedirect.com/science/article/pii/S0749596X2...