158 karma · joined May 29, 2017
If people use Claude without a critical eye, our code bases will grow immensely.
For example “commit and push”
Remember the title “attention is all you need”? Well you need to pay a lot of attention to CC during these small steps and have a solid mental model of what it is building.
However CICD remains tricky. In fact when AI agents start building autonomous, merge trains become a necessity…
You cant trust LLMs for 100%, constant supervision is needed
So during a big Go refactoring I asked Claude to write a python script to do some renames. I hoped it would be faster, more reliable and save some tokens.
Well that was a rabbit hole. I quickly reverted and let CC do it the old way. Hype vs reality.
Still on my list to experiment with CC and Go’s AST tools to tryout refactorings.
At least in the case of lot of automated test coverage and typed language (Go) so it can work independently efficiently.
It will be interesting to see how beginning developers will deal with these bugs as they did not write the code and do not have a mental model of the code. Will quality drop? Perhaps some can be compensated by letting the LLM do extensive testing.
Writing proper code including tests and refactorings takes substantial time.
It is definitely worth it to do this faster, if only to get faster feedback to go back to the first phase; requirements and analysis.
I have experienced this myself, using CC it took me a few hours less to realise i was on the wrong track.
To tackle this, I converted a custom prompt into an application, but there is an interesting trade-off. The application is deterministic. It cannot deal with unknown situations. In contrast to CC, which is way slower, but can try alternative ways of dealing with an unknown situation.
I ended up with adding an instruction to the custom command to run the application and fix the application code (TDD) if there is a problem. Self healing software… who ever thought
What is potentially a problem is the lack of training material for AI agents to generate games on top of this platform.
Writing this I realise, i should more clearly separate the functional tests from the implementation oriented unit tests.
We most likely implement a policy that starters in our company can use Pro. Power users need Max.
This is the big game changer: we have a programming environment where the program can improve itself. That is something Fortran couldn’t do.
I do not get it why they don’t pick Go or Rust so i get a binary.
I noticed that CC’s generated Go code nowadays is very solid. No hallucination recently that i can remember or struck me. I do see youtube videos of people working with js/ts still struggling with this. Which is odd, there is way more training material for the latter. Perhaps the simplicity of Go shines here.
CC might generate Go code for which there are already library functions present. So thorough code reviews are a necessity.
I’m fine that people squash as long the reasoning is recorded in comments and reflected through automated tests (unit AND system/api).
This is also crucial information for AI coding tools.
Still needs a lot of handholding. I do not (yet) think big upfront plans will suddenly start working in the enterprise world. Let it write a failing test first.
You would also expect some eat-your-own-dog-food, why does https://github.com/possibilities/claude-composer/blob/main/s... not use CC with a prompt…
(Ps I left x/twitter a long time)
Yesterday was for me a milestone, i connected Claude Code through MCP with Jira (sse). I asked it to create a plan for a specific Jira issue, ah, excuse me, work item.
CC created the plan based on the item’s description and started coding. It created a branch (wrong naming convention, needs fix), made the code changes and pushed. Since the Jira item had a good description, the plan was solid and the code so far as well.
Disclaimer; this was a simple problem to solve, but the code base is pretty large.
AI has the promise to optimize worker’s efficiency x-fold. This promise was not the case with smartphones, slack, etc.
And AI will change everyone’s work in years to come, especially for developers.