"Going forward we will capitulate and still try to keep the integrity of our benchmark in tact, but from now on every benchmark will be compromised with providers being able tweak things sufficiently to game at least a 30% bump in results."
>We see Astra as a major breakthrough in model intelligence.
You think the author of the benchmark is also in the conspiracy