https://www.linkedin.com/pulse/announcing-universal-mathemat...
The article describes a unifying mathematical framework for representing neural network architectures. It can be used to describe existing ones, like transformers and convolution, but can also be used to generate entirely novel ones. As part of our research, we generated several thousand new architectures, some of which show remarkable properties. The corresponding research paper is up on arXiv: