There’s now an open source alternative to ChatGPT, but good luck running it

Would it be possible to integrate RLHF with BLOOM Petals [0]? Petals lets you run the huge BLOOM model (175B params) with a distributed swarm of machines. iirc it already supports fine-tuning BLOOM, so.. maybe?

[0] https://github.com/bigscience-workshop/petals

I like how this says there’s “now” an open source alternative to chatgpt, as if chatgpt was the first ever language generation model that’s been routed into a chatbot

My read was the novelty lies in the combination of a language model plus a reinforcement learning layer on top, just like chatgpt.

Are they calculating the cost of training these models based on cloud computing costs? I would think it's more economical to just buy a couple DXG stations.