I'm wondering if this is something that hits new developers faster than more experienced ones?
I'm wondering if this is something that hits new developers faster than more experienced ones?
Played with these coding agents for the last couple weeks and instantly noticed the brainrot when I was staring at an empty vim screen trying to type a skeleton helloworld in C.
Luckily the right idioms came back after couple of hours, but the experience gave me a big scare.
Very interesting, wonder what makes our experiences so different? For you "playing for a couple of weeks" have a stronger effect than for me after using them almost exclusively for more than a year, and I don't think I'm an especially great programmer or anything, typical for my experience I think.
Maybe the difference between actually knowing stuff vs surface level? I know a lot of devs just know how to glue stuff together, not really how to make anything, so I'd imagine those devs lose their skills much faster.
People using AI for tasks (essay writing in the MIT study linked below) showed lower ownership, brain connectivity, and ability to quote their work accurately.
> https://arxiv.org/abs/2506.08872
There was a MSFT and Carnegie Mellon study that saw a link between AI use, confidence in ones skills, confidence in AI, and critical thinking. The takeaway for me is that people are getting into “AI take the wheel” scenarios when using GenAI and not thinking about the task. This affects people novices more than experts.
If you managed to do critical thinking, and had relegated sufficient code to muscle memory, perhaps you aren’t as impacted.
My theory is that if you're not full-time coding, it's hard harder to remember the boiler plate and obligatory code entailed by different SDKs for different modules. That's where the documentation reading time goes, and what slows down debugging. That's where agent assisted coding helps me the most.
As an example I have been fighting with agents re-writing or removing guard clauses and structs when dealing with Mach-o fat archives this week, I finally had to break the parsing out into an external module and completely remove the ability for them to see anything inside that code.
I get the convenience for prototyping and throwaway code, but the problem is when you don’t have enough experience with the quirks to know something is wrong.
It will be code debt if one doesn’t understand the core domain. That is the problem with the confidence and surface level competence of these models that we need to develop methods for controlling.
Writing code is rarely the problem with programming in general, correctness and domain needs are the hard parts.
I hope we find a balance between gaining value from these tools while not just producing a pile of fragile abandonware
I guess that's an advantage? People shouldn't have to burden their memory with boilerplate and CRUD code.
The people who used chatGPT had the most difficulty quoting their own work. So not boilerplate, CRUD - but yes the advantage is clear for those types of tasks.
There were definite time and cognitive effort savings. I think they measured time saved, and it was ~60% time saved, and a ~32% reduction in cognitive effort.
So its pretty clear, people are going to use this all over the place.
i dont think it is entirely a case of voluntary outsourcing of critical thinking. I think it's a problem of 1) total time devoted to the task decreasing, and 2) it's like trying to teach yourself puzzle solving skills when the puzzles are all solved for you quickly. You can stare at the answer and try to think about how you would have arrived at it, and maybe you convince yourself of it, but it should be relatively common sense that the learning value of a puzzle becomes obsolete if you are given the answer.
I do still write stuff manually frequently - I often spend 5 minutes writing structs or function signatures to make sure that the LLM won't misunderstand or make something up. Maybe that's why I haven't lost it.
Almost certainly, at least according to Ebbinghaus' forgetting curve.
Right, sounds very credible to me. What did you write, an addition function in each of those?
I wrote a little toy-calculator in each, ended up being ~250 LOC in each of them, not exactly the biggest test but large enough to see if my muscle memory still works which I was happy to discover it still did.
> But now, I'm useless. My mind has turned to pudding. I cannot remember basic boilerplate stuff
> Played with these coding agents for the last couple weeks and instantly noticed the brainrot when I was staring at an empty vim screen trying to type a skeleton helloworld in C.
This is very different from what I'm (not) experiencing. My test was for if I can remember the basic syntax of the language itself, I was never a big framework user, so of course using a framework is about the least interesting test I could do of myself.
Instead, I did the bare minimum to see if my "mind has turned to pudding" or "instantly noticed the brainrot", which would have been visible even for a toy calculator, obviously.
> the people pushing for "AI writing all the code" are not worried about you retaining the "muscle memory" to write addition and substraction functions
What are they worried about then? From your perspective, sounds like they're worried about "using these and those frameworks" but that's far from "real world work" in my experience, and really the least interesting thing you could remember as a developer.
So you only ever wrote code in academic setting? Not being sarcastic, but no realistic software development in commercial setting will happen without frameworks.
> That's not how I understood other's experience to be, they're describing something that won't let them even write toy calculators. Selected quotes:
Well that is literally not what they are describing. The man said "boilerplate code". Again, unless most of the code you wrote was code used in purely academic setting, whether research or teaching, we all understand boilerplate code to mean something like "code to open a file descriptor / iterate through database rows / poll web server for results" etc. So the typical stuff you would implement while relying on abstractions and concepts someone else already defined for you.
> What are they worried about then?
If I had to guess - they are worried about the growing LLM-backlash working against their hoped-for-industry-wide-adoption and their infinite money at some point running out, because at the end of the day, NVIDIA lending OpenAI 100B to invest in MS Azure and Azure using those 100B to purchase NVIDIA chips...is starting to look a lot like circular financing.
> sounds like they're worried about "using these and those frameworks" but that's far from "real world work" in my experience
Again, if your area of work is academic or teaching, then this probably matches your own real world experience. The problem for the LLM-crowd is that there is a lot more people here whose "real world experience" are not toy calculators and isolated algorithm implementation, but actually yes, using "this and that framework", as otherwise the implementation would take un-realistically long. I may know how TLS works, but would I implement it's handshake routine on my own? Only if I did it as a personal excercise, not in a commercial scenario. Same for UI, same for DB ORMs, etc. You name it.