You just have to love Stephen Merity.
His work on QRNN's saved me quite a bit of time and money when I was doing my undergrad dissertation on language models.
This SHA-RNN seems to have surfaced from a similar line of thinking that spawned the QRNN.
His work on QRNN's saved me quite a bit of time and money when I was doing my undergrad dissertation on language models.
This SHA-RNN seems to have surfaced from a similar line of thinking that spawned the QRNN.
[0] http://nlp.fast.ai/classification/2019/09/10/multifit.html