If it's of any help, it's the multi-head attention mechanism, one of the more unique characteristics (although it can be done in other NN's).