The Transformer Blueprint
deeprevision.github.io
deeprevision.github.io
Another area of interesting research is the use of transformer like models for highly dimensional time series prediction. While language and vision are interesting and have their uses, my opinion is the application of these techniques for multidimensional non linear effects in time series may ultimately have more broad and significant impact. Ex:
Admittedly, I am biased to ward visual language and close modalities, and that made miss works happening elsewhere like time series. I will check that out and can potentially add a pointer to the paper you shared. Thanks a bunch :-)