Hacker News Reader

It was the high cost per API call that pulled all the fun out of GPT-3 for me. I hadn’t been following the company at all but believe you based on just that single issue. It looks like GPT-J has open sourced their entire model so I could potentially run it myself for almost-free? If so, that’s going to be much more fun. Thanks for sharing!

View on HN

It's not exactly "almost free"; you need a powerful GPU, which are extremely costly right now. But apart from the cost of that and power, free.

You can rent GPUs from various cloud providers, but those are hilariously expensive too even given datacentre GPU prices.

That thought was why I added “almost” right before posting! It’s free to run, just, except for the expensive parts... AWS still rents out GPU power, right? That might be a bit easier to get started with.

not possible, to run the original gpt3 model, you need at least 8 gpus to just hold all it parameters in memory

Reply on news.ycombinator.com