Regardless, Anthropic is doing some cool research,for example I think this paper is pretty interesting.
A Mathematical Framework for Transformer Circuits: https://www.anthropic.com/index/a-mathematical-framework-for...
A Mathematical Framework for Transformer Circuits: https://www.anthropic.com/index/a-mathematical-framework-for...