dot-product attention is the biggest barrier. This is why there are so many attempts to linearize it.