Hacker News Reader

Comment by jjice | Hacker News Reader

As a layman outsider, it doesn't seem like it. Anthropic is doing great work (I personally prefer Claude) and now there are so many quality LLMs coming out that I don't know if OpenAI is particularly special anymore. They had a lead at first, but it feels like many others are catching up.

I could be _very_ wrong though.

View on HN

Agreed. Sonnet 3.5 is still by far the most useful model I've found. o1-mini is priced similar and no where near as useful even if programming which it is suppose to excel. I recently tried o1-mini using `aider` and it would randomly start responding in russian mid way through despite all input being in english. If anything, I think Anthropic still has a decent lead when it comes to price to performance. Their update to Haiku and Opus will be very interesting.

They recently released a new model, called "o1-preview", that is significantly ahead of the competition in terms of mathematical reasoning.

On benchmarks where it’s impossible to verify whether there’s contamination?

Is it? There was some discussion on HN a while ago that it is better than gpt4o but nothing about the competition and that seems quite doubtful compared to e.g. alphaproof.

Also, if "significantly ahead" just means "a few months ahead" that does not justify the valuation.

> that is significantly ahead

Perhaps, but at most generous, it’s three months ahead of competitors I imagine

Reply on news.ycombinator.com