From the same twitter thread, a dense implementation in less than 100 lines of plan C:

https://github.com/davidar/eigenGPT/tree/c