If I am reading the table correctly they are claiming it is better than all models but 3.5-Sonnet
Is anyone with X premium able to confirm the vibe check -- Is the model actually good or another case of training on benchmarks?
Is anyone with X premium able to confirm the vibe check -- Is the model actually good or another case of training on benchmarks?
So results are mixed, but the real takeaway is this is a competitive model that is good enough to be worth using today. It puts xAI significantly above their previous position, and up near the top of the field with OpenAI, Anthropic, Google, and Meta. And their new H100 cluster should allow them to keep up with the next wave of releases, whenever that starts.
More importantly, if the model is not a huge leap at this point I just don't care if it is as good as the very limited models we already have because I am not impressed by any of these anymore.
Anything less than a 3.5 to 4 jump from here is just not going to vibe for me.
Right now I'm not really a believer in Grok and I doubt it will be worth using.