Hacker News Reader

If Google only used data that isn't copyrighted, they'd probably make a big deal about it, just like Adobe does with their Firefly model. Also, it's not really possible for OpenAI to just take out certain parts from the model without retraining the whole thing. The drop in quality might be due to attempts to make the model work faster through quantization and additional fine-tuning with RLHF to curb unwanted behavior.

View on HN

So basically, you're of the belief whatever OpenAI has done it's some kind of magic which Google cannot / has not figured out?

I re-read, didn't mean to sound snarky, although it did, just curious if that's what you really believe is going down??

I think Google still has a decent chance of catching up. It's just a bit surprising to see them fall behind in an area they were supposed to be leading, especially since they wrote the paper which started all of this. Also, Anthropic is already kind of close to OpenAI, so I don't think OpenAI has some magic that no one else can figure out. In the future, I predict that these LLMs will become a commodity, and most of the available models will work for most tasks, so people will just choose the cheapest ones.

Reply on news.ycombinator.com