Hi there,

Just so you know, I'm the one who wrote RWKV.f90. After making a lightweight autograd package that's a lot like PyTorch, but in Go (I called it spaGO), I am now passionately working on adapting the same concepts to the Fortran language.

But first things first, I want to make sure that using your GPU is as easy as pie. That's my next challenge.

ADIFOR was one of (if not the first) large scale automatic differentiation tools

https://www.mcs.anl.gov/research/projects/adifor/