An open-source implementation of the CrossFormer: A Versatile Vision Transformer Hinging on Cross-scale Attention research paper in Google's JAX and Flax.
JAX/Flax Repository: https://github.com/conceptofmind/Crossformer-flax
Crossformer Research Paper: https://arxiv.org/abs/2108.00154
Official Github Repository: https://github.com/cheerss/CrossFormer
In collaboration with Dr. Phil 'Lucid' Wang: https://github.com/lucidrains.