An #opensource implementation of the Twins: Revisiting the Design of Spatial Attention in Vision Transformers research paper in Google's #JAX and #Flax.

JAX/Flax Repository: https://github.com/conceptofmind/Twins-SVT-Flax

Twins SVT Research Paper: https://arxiv.org/abs/2104.13840

Official Github Repository: https://github.com/Meituan-AutoML/Twins

In collaboration with Dr. Phil 'Lucid' Wang: https://github.com/lucidrains.