Feel free to steal! This was one shot with Claude Code. You can take it and adopt it to your need
2,126 karma · joined June 16, 2012
Feel free to steal! This was one shot with Claude Code. You can take it and adopt it to your need
But overall, this is pretty normal for compilers to have this sort of "unexpected" tests failing due to some work in an area. It happened to me when I was coding everything manually back in the day too
In a project like mine (https://github.com/tsz-org/tsz) I am constantly frustrated that models were not doing enough research and were not taking into account other situations. Again and again models would produce code that would fix one thing and break 2 other tests that were "unrelated".
With Fable it seems like tasks are taking much longer (I have not seen a pull request from Fable sessions yet) but reading the transcription of those sessions I can see how it is doing the right thing by not leaving any stone unturned.
As the article says, it's hard to communicate this "feeling" about models because it is very project specific but I thought I share
From the model card:
In light of the ability of recent models to accelerate their own development, we've implemented new interventions that limit Claude's effectiveness for requests targeting frontier LLM development (for example, on building pretraining pipelines, distributed training infrastructure, or ML accelerator design. Using Claude to develop competing models already violates our Terms of Service, but enforcing this restriction through our safeguards avoids accelerating the actors most willing to violate these terms. Unlike our interventions for cybersecurity, biology and chemistry, and distillation attempts, these safeguards will not be visible to the user.
I know people are desperate for a Siri that works. The convince of just talking to your phone is priceless. If Apple gets this right, this is a huge deal – which it seems they are on the right track.
People are still talking to Siri for basic stuff like timers and alarms because it works, doesn't need an app, works when phone is locked or even away from you. If this works for more complex tasks like texting and general questions Apple will have the upper hand over Meta and Google in this new way of using computers/internet.
Apple also took a very clever approach for Capex and general AI strategy. Everyone knows that the best intelligence will eventually become a commodity and Apple decided to step aside from this expensive experiment. That's worth pointing out too.
I have an iPhone 16 that was promised to have it. Now they are saying some features are available only on 17+ models
1. user clicks a button and closes the tab thinking transaction is done and it's important that transaction is done
2. conflict resolution is difficult or impossible in future client wake up
Lots of jobs have been automated away and careers based on those jobs faded away in history. Maybe in near future there won’t be a ton of opportunities for software engineers in the traditional form. I’m also embracing for that future.
There were people called calculators that did manual calculations in the past. There were people hand weaving all the fabric. There were people painting cars in the factory. All those jobs are gone for the most part.
We are sitting here portending there is going to be demand for software engineers managing those engineer robots but let’s be real. The demand for software is not increasing at the rate software engineering is becoming efficient using those robots. Some (many) of us have to find new careers.
My point of working on tsz is to learn how to do very big projects with AI. Eventually the same workflows and attitude can be leveraged to build customer product apps with UI as well. I see that OpenAI is leveraging automated browser testing and even videos as part of their workflow. I think as models get better this direction for making software would eventually make sense. I don't think we're there yet though. But at least, unlike OpenAI vague claims I can share the output with you to see!
Most of the solutions that offer a very high level of automation like Lovable are a bit too optimistic and solutions are not tightly coupled with lots of automated testing.
You can see the slop here
It's exciting that many can build useful things today. I'm a little existentially upset that I'm not so special anymore though.
Currently tsz passes nearly 100% of TypeScript tests but that is not enough. I want it to be able to type check complex things like type-challenges solutions or complex utility type packages. I'm stress testing it with a repo with 1.5 million lines of code.
I'm constantly assigning AI agents tasks to find bugs in tsz and open issues.
I'll say this is "alpha" when it can do all those things plus matching tsc exactly in thousands of open source projects where tsc reported type errors. It's easy to find CI runs that tsc reported errors. I'll build a database of all the cases I've verified tsz with and will publish those. Hoping that can give folks confidence that tsz is robust
For now, tsz is just a work in progress.
It's already showing results that is nearly 3x faster than tsgo. For multi-file large projects I have some ideas to implement to make it faster there too.
Once tsz is fast and stable I'll shift focus on making sound mode a reality.
> Not at 100% - and I want to be straight about why that's a longer road...
https://github.com/user-attachments/assets/961eff6c-0060-45d...
I just want Claude Code to stop giving up on achieving tasks. It's so annoying. Even with `/goal` or the new `ultracode` it gives up constantly.
My project is very complex (https://github.com/mohsen1/tsz) but Codex has no problem keep grinding without stopping like that
So far Codex /goal has been amazing but Claude Code /goal or even /loop does not work hard enough and gives up. I have observed it just claiming it’s “iterating” in a broken loop or simply giving up.
This is an interesting development. npm after all is the de-facto ecosystem and leaning into it makes sense.
I'm wondering how Deno would've been received if it supported npm and package.json from day 1.
In tsz I have hard gates that disallow doing work in the wrong crate etc.