Hi there,
Just so you know, I'm the one who wrote RWKV.f90. After making a lightweight autograd package that's a lot like PyTorch, but in Go (I called it spaGO), I am now passionately working on adapting the same concepts to the Fortran language.
But first things first, I want to make sure that using your GPU is as easy as pie. That's my next challenge.