RWKV had a paper accepted at EMNLP and released models which match the performance of equivalent transformers.

What else are you looking for?