We need technical details, example workflows, case studies, social proof and documentation. Especially when it's so trivial to roll your own agent.
2,646 karma · joined October 18, 2020
We need technical details, example workflows, case studies, social proof and documentation. Especially when it's so trivial to roll your own agent.
But I was inspired to use Claude Code to create my own personal assistant. It was shocking to see CC bang out an MVP in one Plan execution. I've been iterating it all week, but I've had it be careful with token usage. It defaults to Haiku (more than enough for things like email categorization), properly uses prompt caching, and has a focused set of tools to avoid bloating the context window. The cost is under $1 per check-in, which I'm okay with.
Now I get a morning and afternoon check-in about outstanding items, and my Inbox is clear. I can see this changing my relationship to email completely.
My initial prompting is boilerplate at this point, and looks like this:
(Explain overall objective / problem without jumping to a solution)
(Provide all the detail / file references / past work I can think of)
(Ask it "what questions do you have for me before we build a plan?")
And then go back and forth until we have a plan.
Compared to my work with CC six months ago, it's just much more capable, able to solve more nuanced bugs, and less likely to generate spaghetti code.
I've been using CC more or less 8 hrs/day for the past 2 weeks, and if anything it feels like CC is getting better and better at actual tasks.
Edit: Before you downvote, can you explain how the model could degrade WITHOUT changes to the prompts? Is your hypothesis that Opus 4.5, a huge static model, is somehow changing? Master system prompt changing? Safety filters changing?
My guess is you're a software developer (as I am), and in my opinion the fatal flaw of our group is the incorrect belief that we could do anything or solve any problem by simply decomposing it into smaller and smaller components. The thing is, for a big enough problem, there are an almost infinite number of ways to break it down and then build it back up. In optimization terms, complex projects are highly nonlinear problems, so you may be able to understand what the inputs are, but it sometimes takes wisdom and experience to tune the parameters.
Further, the "model collapse" hypothesis of 2020/2021 seems to have failed to materialize. Maybe we're still too early, and we're not yet seeing negative effects of OpenAI training on OpenAI output. But maybe "slop" is not being rewarded as much as human content, and having humans in the loop (even as readers) is preventing a slide into incoherence.
Will LLMs eventually disincentivize people from producing and publishing new original content? If that content is easily replicated by an LLM query, maybe. And maybe it's not the worst thing in the world. 5 years ago I would have bought an "FFmpeg Cookbook" from O'Reilly, but now I would just tell Claude exactly what I'm trying to achieve. As a consumer, I'm better off, and arguably we've saved the author of a hypothetical FFmpeg Cookbook weeks out of their precious life. Weeks they could spend doing something—anything—more valuable than rewording FFmpeg documentation.
Unfortunately, less privileged users will have to endure the sea of AI content that still preys on the unauthenticated. It will be like using the web without an ad blocker, but 1000X worse.
I can't count the number of times I've ordered a book from Amazon (1st party, Amazon as the seller) and received an obvious counterfeit, with fuzzy text and a poorly printed cover. On one occasion, the scanning/OCR process had missed most of one chapter, so there were just section headers, page numbers and blank pages.
Unfortunately publishers and manufacturers don't have a lot of leverage with Amazon. If there's pressure coming from somewhere, it must be coming from a regulatory body.
Anecdotally, I have friends who have recently bought turntables out of the blue and gotten into vinyl. Other friends who never had any interest in my analog cameras are asking about film. My wife has even switched from scrolling Instagram at night to working on a crossword book with a pencil.
None of them have put it exactly this way, but in divisive times, I think social media is just exhausting. And now you can't even really tell what's real.
Yes, but with LLMs, sometimes simply mentioning the right words is enough to prime the model in the direction you want to take it. If you start a prompt talking about leading and type pairings, it will take greater care with typography. You don't need to be an expert typographer to take advantage of this phenomenon.
The author does not mention whether the generated project plan actually looked good or plausible. If it is, where is the harm? Just that the manager had their feelings hurt?