Capsule networks were conceptually an early attempt at transformers.