to be clear this work is not based on redpajama - though we did discuss that in the previous episode https://twitter.com/swyx/status/1648080532734087168?s=46&t=9...
I thought I read that, is it based upon:
https://arxiv.org/abs/2211.15533 (The Stack) ?