An open-source implementation of the CvT: Introducing Convolutions to Vision Transformers research paper in Google's JAX and Flax.
JAX/Flax Repository: https://github.com/conceptofmind/CvT-flax
CvT Research Paper: https://arxiv.org/abs/2103.15808
Official Github Repository: https://github.com/microsoft/CvT
In collaboration with Dr. Phil 'Lucid' Wang: https://github.com/lucidrains.