Hacker News Reader

I think it's good at basic coding and is cheaper and faster. Trying it vs Fable 5.1 I don't see it being even close capability-wise. What I mean by basic coding is "write a script to parse this data" and answering some questions based on the code. It does that well and answers fast. However, when it comes to planning and thinking through a more complicated design problem it's just not there yet.

View on HN

It's not even close. Some benchmarks show 3.8 Flash as being close to Astra (DeepSWE v1.1), but they are mostly "bench-maxed". Newer benchmarks like Terminal-Bench 4.0 show Astra at 57.9% and 3.8 Flash at 19.1%. For anyone who has tried to code with Gemini models, there is no contest here.

Astra wins handily on every other benchmark, too. Research, science, 3D, visual, Humanity's Last Exam, etc.

You can't compare a heavyweight, expensive and slow model to Flash. Comparing apples to oranges.

I agree, and I didn't compare them. The users above me did. I was explaining that they are, in fact, incomparable.

Reply on news.ycombinator.com