Retentive Network: A Successor to Transformer Implemented in PyTorch

"Retentive Network: A Successor to Transformer for Large Language Models" (2023) https://arxiv.org/abs/2307.08621 https://www.arxiv-vanity.com/papers/2307.08621/ https://huggingface.co/papers/2307.08621 https://scholar.google.com/scholar?hl=en&as_sdt=0%2C33&q=Ret...

- https://news.ycombinator.com/item?id=36831956 2 days ago

note: this is not from the original authors of the paper.