is it really that hard to get access? it was a pretty painless process for me and I was just hacking together some toy projects.

That's a big if. I'd be happy with just GPT-2.