5,743 karma · joined December 1, 2012
Here is a sample report that tries out the cheaper models + the newest Kimi2.6 model against the 5.4 'gold' testcases from the repo: https://repogauge.org/sample_report.
Happy to run it on your repos for a free report: hi@repogauge.org
We're literally trying to build an intelligence to replace us.
It is pretty magical to go from brainstorming an idea in the evening, having ChatGPT Pro spit out a long list of beads to implement it, leaving it running over night in a totally empty repo and waking up to a mostly-implemented project.
I wrote an article on this if you're interested: https://x.com/siliconcow/status/2035373293893718117
When I asked the team that is supposed to use it, "We haven't used that in six months and it wouldn't be missed if it were to go away".
I've seen teams build and re-build the same infrastructure over and over.
I saw a request that could have been met with a few SQL queries and a dashboard got turned into a huge endeavor that implements parts of an ETL, Configuration Management, CI/CD, and Ticketing system and is now in the critical path of all requests all because people didn't ask the right questions and the incentive in a large organization is to build a mini-empire to reign over.
That said, smart infrastructure investment absolutely can be a competitive advantage. Google's infrastructure is, IMO, a competitive advantage. The amount of vertical integration and scale is unparalleled.
If I'm on vacation I don't even think about having a gum. It's only when I'm working, notice I'm dragging, and remember the option.
For example China (not without its flaws) largely skipped over the digital drug phase and went straight into funding socially beneficial things like energy and materials production, AI and robotic enabled manufacturing, and large scale infrastructure build out. So ten years later they have a lot of socially productive things and we have a lot of socially unproductive things.
It also has neuro-protective effects if you're an older gentleman.
My backup has been Opencode + Kimi K2. It's definitely not as strong as even Sonnet but it's pretty fast and is serviceable for basic web app work like the above.
Instead of not driving to work to save fuel, frugal companies are going to have their engineers work on weekends to save tokens.
Given how subsidized the subscription plans are and the oss benchmaxxing vs real life performance- you're paying much more for far worse models.