HNHacker News
TopNewBestAskShowJobs

dhorthy

1,188 karma · joined March 2, 2018

building @ humanlayer.com
submissionscomments
dhorthy··on Getting AI to work in complex codebases
https://en.wikipedia.org/wiki/Product_requirements_document
dhorthy··on Getting AI to work in complex codebases
i mean there's also the fact that claude code injects this system message into your claude.md which means that even if your claude.md sucks you will probably be okay:

<system-reminder> IMPORTANT: this context may or may not be relevant to your tasks. You should not respond to this context or otherwise consider it in your response unless it is highly relevant to your task. Most of the time, it is not relevant. </system-reminder>

lots of others have written about this so i won't go deep but its a clear product decision, but if you don't know what's in your context window, you can't respond/architect your balance between claude.md and /commands well.

dhorthy··on Getting AI to work in complex codebases
I would say its much more about abstraction and the leverage abstractions give you.

You'll also note that while I talk about "spec driven development", most of the tactical stuff we've proven out is downstream of having a good spec.

But in the end a good spec is probably "the right abstraction" and most of these techniques fall out as implementation details. But to paraphrase sandy metz - better to stay in the details than to accidentally build against the wrong abstraction (https://sandimetz.com/blog/2016/1/20/the-wrong-abstraction)

I don't think delegation is right - when me and vaibhav shipped a week's worth of work in a day, we were DEEPLY engaged with the work, we didn't step away from the desk, we were constantly resteering and probably sent 50+ user messages that day, in addition to some point-edits to markdown files along the way.

dhorthy··on Getting AI to work in complex codebases
alex reibman proposed hyperengineering

i've also heard "aura coding", "spec-driven development" and a bunch of others I don't love.

but we def need a new word cause vibe coding aint it

dhorthy··on Getting AI to work in complex codebases
yeah once again you need the right context to override what's in the weights. It may not know how to use the responses api, so you need to provide examples in context (or tools to fetch them)
dhorthy··on Getting AI to work in complex codebases
yes - correct. For the record, if spending raw tokens, the 2 prs to baml cost about $650.

but yes we switched off per-token this week because we ran out of anthropic credits, we're on max plan now

dhorthy··on Getting AI to work in complex codebases
I tend to think about it like vim - you will feel slow and annoyed for the first few weeks, but investing in these skills are massive +EV long term
dhorthy··on Getting AI to work in complex codebases
s/unique/lazy
dhorthy··on Getting AI to work in complex codebases
yeah i love that there is a lot of source data for "what is good idiomatic go" - the model doesn't have it all in the training set but you can easily collect coding standards for go with deep research or something

And then I find models try to write scripts/manual workflows for testing, but Go is REALLY good for doing what you might do in a bash script, and so you can steer the model to build its own feedback loop as a harness in go integration tests (we do a lot of this in github.com/humanlayer/humanlayer/tree/main/hld)

dhorthy··on Getting AI to work in complex codebases
i strongly disagree with this - if anything, using AI to code real production code in real complex codebase is MORE technical than just writing software.

Staff/Principal engineers already spend a lot more time designing systems than writing code. They care a lot about complexity, maintainability, and good architecture.

The best people I know who have been using these techniques are former CTOs, former core Kubernetes contributors, have built platforms for CRDTs at scale, and many other HIGHLY technical pursuits.

dhorthy··on Getting AI to work in complex codebases
me too :)
dhorthy··on Getting AI to work in complex codebases
why do you think go is better than python (i have some thoughts but curious your take)
dhorthy··on Getting AI to work in complex codebases
definitely - the standford video has a slide about how many cases caused people to be even slower than without AI
dhorthy··on Building sub-100ms autocompletion for JetBrains IDEs
someone had to do it
dhorthy··on We put a coding agent in a while loop
sure fair enough. I guess i'm mostly being pragmatic here.

Plus i'm not convinced that generating "kubectl"...json..."get"...json..."pod"... is easier for most models than "bash"...json..."kubectl get pod"...

dhorthy··on We put a coding agent in a while loop
interesting - what makes you say that?
dhorthy··on We put a coding agent in a while loop
this is more about the service account than the runtime environment i think. you put your admin service account in docker the agent can still wreak havoc. Docker lets you hide the admin service account on your host FS from the agent.
dhorthy··on We put a coding agent in a while loop
oh yeah we had claude diagnose a production k8s redis outage last week (figured out that we needed to launch a new instance in a new AZ to pick up the previous redis' AZ-scoped EBS PVC after a cluster upgrade).
dhorthy··on We put a coding agent in a while loop
i spend a lot of time thinking about this.

At humanlayer we have some OSS projects that are 99% written by AI, and a lot of it was written by AI under the supervision of developer(s) that are no longer at the company.

Every now and then we find that there are gaps in our own understanding of the code/architecture that require getting out the old LSP and spelunking through call stacks.

It's pretty rare though.

dhorthy··on We put a coding agent in a while loop
Yeah fair enough lol…usually I end up building model-optimized scripts instead of mcp which just flood context window with json and uuids (looking at you, linear) - much better to have Claude write 100 lines of ts to drop a markdown file with the issue and all comments and no noise
dhorthy··on We put a coding agent in a while loop
Give it a spin
dhorthy··on We put a coding agent in a while loop
combat how? (And yes, yes I do)
dhorthy··on We put a coding agent in a while loop
still don’t know why you need an MCP for this when the model is perfectly well trained to write files and run kubetctl on its own
dhorthy··on We put a coding agent in a while loop
Hmm what sorts of advice in the last year are you referring to? Like the “run it ten times and pick the best one” thing? Or something else?

I kind of agree that picking from 10 poorly-promoted projects is dumb.

The engineering is in setting up the engine and verification so one agent can get it right (or 90% right) on a single run (of the infinite ish loop)

dhorthy··on We put a coding agent in a while loop
When Claude starts deploying Kafka clusters I’m outro
dhorthy··on We put a coding agent in a while loop
Yeah you can easily tweak this to push to a branch or a fork or something in the generated prompt.md
dhorthy··on We put a coding agent in a while loop
Yeah the NIH thing is super on point. small saas tools for everything is done. Bring on the hand coded custom in-house admin monolith?

Is Unix “small sharp tools” going away? Is that a relic of having to write everything in x86 and we’re now just finally hitting the end of the arc?

dhorthy··on We put a coding agent in a while loop
was deeply unsettling among other things
dhorthy··on OpenAI Harmony on PyPI – moving more clients to rust core?
stumbled on this - reminds me of what the BAML folks have been doing for a while - rust core, native bindings in every language
dhorthy··on We revamped our docs for AI-driven development
love this feature and hope to see more of it

> We're working on an escalateIssue tool that will allow AI Agents to report issues directly to us, so we can know they are happening faster and fix them.

If AI chat interfaces are the new browser / search, then MCP support workflows are the new intercom

← PreviousPage 4 of 8Next →