Hacker News Reader

Is it still feasible to still train this model at home?

If not, then how can I fine tune it to fit my own data? Will they provide API for it?

"Reading the OpenAI GPT-3 paper. Impressive performance on many few-shot language tasks. The cost to train this 175 billion parameter language model appears to be staggering: Nearly $12 million dollars in compute based on public cloud GPU/TPU cost models (200x the price of GPT-2)"

https://twitter.com/eturner303/status/1266264358771757057

Nearly $12 million dollars in compute based on public cloud GPU/TPU cost models (200x the price of GPT-2)"

Oh! So only about $1 million on bare metal.

Reply on news.ycombinator.com