Outsourcing thinking
erikjohannes.no
erikjohannes.no
He went on to something else but his stress levels went way down.
All this is to say: I agree with you if the human connection is in good faith. If it isn’t then LLMs are helpful sometimes.
On the other hand, before LLMs came along, didn't we ask a friend or colleague for their opinion on an email we were about to write to our boss about an important professional or personal matter? I have been asked several times to give advice on the content and tone of emails or messages that some of my friends were about to send. On some occasions, I have written emails on their behalf.
Is it really any different to ask an LLM instead of me? Do I have a better understanding of the situation, the tone, the words, or the content to use?
Firstly, when you ask a friend or colleague you're asking a favour that you know will take them some time and effort. So you save it for the important stuff, and the rest of the time you keep putting in the effort yourself. With an LLM it's much easier to lean on the assistance more frequently.
Secondly, I think when a friend is giving advice the responses are more likely to be advice, i.e. more often generalities like "you should emphasize this bit of your resume more strongly" or point fixes to grammar errors, partly because that's less effort and partly because "let me just rewrite this whole thing the way I would have written it" can come across as a bit rude if it wasn't explicitly asked for. Obviously you can prompt the LLM to only provide critique at that level, but it's also really easy to just let it do a lot more of the work.
But if you know you're prone to getting into conflicts in email, an LLM powered filter on outgoing email that flagged up "hey, you're probably going to regret sending that" mails before they went out the door seems like it might be a helpful tool.
- I find this a point in favor of LLM and not a flaw. It is a philosophical stance, one for which what does not require effort or time is intrinsically not valuable (see using GLP peptides vs sucking it up for losing weight). Sure, it requires effort and dedication to clean your house, but given the means (money), wouldn't you prefer to have someone else clean your place?
"Secondly, I think when a friend is giving advice the responses are more likely to be advice"
- You can ask an LLM for advice instead of writing directly and without further reflection on the writing provided by the model. Here I find parallels with therapy, which in its modern version, does not provide answers, but questions, means of investigation, and tools to better deal with the problems of our lives.
But if you ask people who go to therapy, the vast majority of them would much prefer to receive direct guidance (“Do this/don't do that”).
In the cases in which I wrote a message or email on behalf of someone else, I was asked to do it: can you write it for me, please? I even had to write recommendation letters for myself--I was asked to do that by my PhD supervisor.
If you are concerned about possible harms in "outsourcing thinking and writing" (whether to an LLM or another human) then I think that the frequency and completeness with which you do that outsourcing matters a lot.
It can become an indispensable asset over time, or a tool that can be used at certain times to solve, for example, mundane problems that we have always found annoying and that we can now outsource, or a coaching companion that can help us understand something we did not understand before. Since humans are naturally lazy, most will default to the first option.
It's a bit like the evolution of driving. Today, only a small percentage of people are able to describe how an internal combustion engine works (<1%?), something that was essential in the early decades after the invention of the car. But I don't think that those who don't understand how an engine works feel that their driving experience is limited in any way.
Certainly, thinking and reasoning are universal tools, and it could be that in the near future we will find ourselves dumber than we were before, unable to do things that were once natural and intuitive.
But LLMs are here to stay, they will improve over time, and it may well be that in a few decades, the human experience will undergo a downgrade (or an upgrade?) and consist mainly of watching short videos, eating foods that are engineered to stimulate our dopamine receptors, and living a predominantly hedonistic life, devoid of meaning and responsibility. Or perhaps I am describing the average human experience of today.
Think about dating apps, pictures could be fake, and now words exchanged can be fake too.
You thought you were arguing with a gentle and smart colleague by chat and mails, too bad, when you meet then at a conference or at a restaurant you find them very unpleasant.
> Our inability to see opportunities and fulfillment in life as it is, leads to the inevitable conclusion that life is never enough, and we would always rather be doing something else.
I agree with the article completely, as it effectively names an uneasy feeling of hesitation I’ve had all along with how I use LLMs. I have found them tremendously valuable as sounding boards when I’m going in circles in my own well-worn cognitive (and sometimes even emotional) ruts. I have also found them valuable as research assistants, and I feel grateful that they arrived right around the time that search engines began to feel all but useless. I haven’t yet found them valuable in writing on my behalf, whether it’s prose or code.
During my formal education, I was very much a math and science person. I enjoyed those subjects. They came easily to me, which I also enjoyed. I did two years of liberal arts in undergrad, and they kicked my butt academically in a way that I didn’t realize was possible. I did not enjoy having to learn how to think and articulate those thoughts in seminars and essays. I did not enjoy the vulnerability of sharing myself that way, or of receiving feedback. If LLMs had existed, I’m certain I would have leaned hard on them to get some relief from the constant feeling of struggle and inadequacy. But then I wouldn’t have learned how to think or how to articulate myself, and my life and career would have been significantly less meaningful, interesting, and satisfying.
But… I do agree with you, that had these things been there, I/we’d all be leaning on them. It’s the manageable hardship of life that makes it worth it, we better ourselves through the pain. My 18-year old self would complain, as would any me up to mid-30s. I’d have to insist to him that things will get better, but that he must work on what needs improving. Can’t just ask a language model for validation.
previously, this happened with print media. Then it happened with the airwaves. It only makes logical sense that the trend continues with LLMs.
Basically, the fundamental issue is that the source of information is under someone else's control, and that someone will always have an agenda.
But with LLMs, it's crucial to try change the trend. IMHO, it should be possible for a regular person to own their computing - this should include the LLM capability/hardware, as well as the model(s). Without such capabilities, the exact same will happen as has in the past with new technologies.
And regular persons will not care about this and will select a model with biases of anyone who they deem "works better for me at this one task that I needed".
Just like you said:
> previously, this happened with print media. Then it happened with the airwaves. It only makes logical sense that the trend continues with LLMs.
I wish it wasn't so, but I have no idea how to make people care about not being under someone's control.
It still got her enough extra buck to build a house in the city after moving out from the village.
"modern first-world capitalism often outsources the human cost of it's milieu to the third world"
This is a bit of "damned if you do, damned if you don't".
If you don't do any business with poorer countries, you can be called a heartless isolationist who does not want to share any wealth and only hoards his money himself.
If you do business with poorer countries, but let them determine their own internal standards, you will be accused of outsourcing unpleasant features of capitalism out of your sight.
If you do business with poorer countries and simultaneously demand that they respect your standards in ecology, human rights etc., you will be accused of ideological imperialism and making impossible demands that a poorer country cannot realistically meet.
Pick your poison.
I don't worry about that any more because there's so much competition: dozens of organizations now produce usable LLMs and the "best" is no longer static. We have frontier models from the USA, France (Mistral) and China now.
The risk of a model monopoly centralizing cultural power feels a lot lower now then it did a couple of years ago.
Which incentivizes the model vendors not to mess with the models in ways that might lose them customers.
And commercial biases wouldn't necessarily be affected by competition in the way that you're describing. For example, if it becomes profitable for one of these companies to offer to insert links to buy ingredients at WalMart (or wherever) for the goulash recipe you asked for that's going to become the thing that companies go after.
And all of this assumes that these biases will be obvious rather than subtle.
Do you mean like Grok is already doing in such a ham-fisted way?
Have too many of us outsourced our ability to raise horses for transport?
Surely you're capable of walking all day without break?
Although, congestion pricing is a good counter-example. On the surface it looks like it is designed to benefit users of public transportation. But turns out it also benefits car-owners, because it reduces traffic jams and lets you get to your destination with your own car faster.
Designing everything around cars hurts everyone including car owners. Having no option but to drive everywhere just sucks.
Network/snowball effects are not all good. If local businesses close because everybody drives to WalMart to save a buck, now other people around those local businesses also have to buy a car.
I remember a couple of decades ago when some bus companies in the UK were privatized, and they cut out the "unprofitable" feeder routes.
Guess what? More people in cars, and those people didn't just park and take the bus when they got to the main route, either.
Everybody thinks they're customers when they buy a car, but they're really the product. These industries, and others, are the real customers
So much so that my comment attracted downvotes.
C'est la vie.
But this makes me super weird! This is the whole point of social media bans for kids: if you make it optional, it'll still be prevalent and people making healthy choices will be social weirdos. Healthy paths need to be free and accessible, and things need to be built around them (eg don't assume everyone has a smartphone, etc)
Fermentation was a great way to /preserve/ food, but it can be a bit hit and miss. Pickling can be outright dangerous if not done correctly - botulism is a constant risk.
When canning of foods came along it was a massive game changer, many foods became shelf stable for months or years.
Fermentation and pickling was dropped almost universally (in the West).
What are you talking about? What do you think pickles are? Or sauerkraut, for that matter?
How often have you made them yourself, how often does your friend at work make them (if ever?)
Edit: I'm sure you can add to https://news.ycombinator.com/item?id=46733306
Was it 50 years? 100?
That's exactly what worries us.
> Surely they know the risks, and surely people will be just as responsible with AI
Everyone loves watching films until they get a curriculum with 100 of them along with a massive reading list, essays, and exams coming up.
Apparently, my competitiveness lasts for a month.
Gaming is much more fun when you get to decide when to quit and how to play.
In my own work, I found the real failure mode wasn’t using AI, it was automating the wrong parts. When I let AI generate summaries or reflections for me, I lost the value of the task. Not because thinking disappeared, but because the meaning-making did.
The distinction that’s helped me is: - If a task’s value comes from doing the thinking (reflection, synthesis, judgment), design AI as a collaborator, asking questions, prompting, pushing back. - If the task is execution or recall, automate it aggressively.
So the problem isn’t that we outsource thinking, it’s that we sometimes bypass the cognitive loops that actually matter. The design choice is whether AI replaces those loops or helps surface them.
I wrote more about that here if useful: https://jonmagic.com/posts/designing-collaborations-not-just...
We already saw a softer version of this with web search and GPS: people didn’t suddenly forget how to read maps, but schools and orgs stopped teaching it, and now almost nobody plans a route without a blue dot. I suspect we’ll see the same with writing and judgment: the danger isn’t that nobody thinks, it’s that fewer people remember how.
That said, LLMs are perhaps accelerating that but aren’t the only cause (lack of reading, more short form content, etc)
Humans are highly adaptable. It's hard to go back while the thing we're used to still exists, but if it vanished from the world we'd adapt within a few weeks.
Even just writing notes you'll never refer to again, you're making yourself codify vaguer ideas or impressions, test assumptions, and then compress the concept for later. It's an new external information channel between different regions of your head which seems to provide value.
From there you can also go from first draft to feedback.
My fundamental argument: The way the average person is using AI today is as "Thinking as a Service" and this is going to have absolutely devastating long term consequences, training an entire generation not to think for themselves.
In that sense I think getting caught up in “religion bad for tech” zeitgeist misses the point of what religion actually is. Collectively shared ritual. Belief in God, and specific shades of that, is just the step of the dance the bird does in this case. Taking a step back, plenty of atheists engage in collectively shared ritual too. Belief in the 9-5, the bludgeon that is the four years to specialize vs lifelong apprentanceships towards true mastery, economics constraining choice rather than pure skill. Do these rituals not also hold our species and technological development back? If we talk about religion, it is worth also considering the mountain of other blockers towards progress we have built for ourselves in this collectively agreed upon daily society ritual we all partake upon.
[1] https://plato.stanford.edu/entries/pythagoreanism/ [2] https://en.wikipedia.org/wiki/Pythia
With regards to Pythagoreanism, Pythagoras himself thought of mathematics in religious ways. From the entry on Pythagoras (https://plato.stanford.edu/entries/pythagoras/) in the SEP:
> The cosmos of the acusmata, however, clearly shows a belief in a world structured according to mathematics, and some of the evidence for this belief may have been drawn from genuine mathematical truths such as those embodied in the “Pythagorean” theorem and the relation of whole number ratios to musical concords.
There are numerous sections throughout both of these entries that discuss Pythagoras, mathematics, and religion. Plato too is another fruitful avenue, if you wanted to explore that further.
It is unclear that a human thinking about things is going to be an advantage in 10, 20 years. Might be, might not be. In 50 years people will probably be outraged if a human makes an important decision without deferring to an LLM's opinion. I'm quite excited that we seem to be building scaleable superintelligences that can patiently and empathetically explain why people are making stupid political choices and what policy prescriptions would actually get a good outcome based on reading all the available statistical and theoretical literature. Screw people primarily thinking for themselves on that topic, the public has no idea.
https://en.wikipedia.org/wiki/The_Feeling_of_Power
That said, I maintain there are huge qualitative differences between using a calculator versus "hey computer guess-solve this mess of inputs for me."
The critical difference between AI and a tool like a calculator, to me, is that a calculator's output is accurate, deterministic and provably true. We don't usually need to worry that a calculator might be giving us the wrong result, or an inferior result. It simply gives us an objective fact. Whereas the output of LLMs can be subjectively considered good or bad - even when it is accurate.
So imagine teaching an architecture student to draw plans for a house, with a calculator that spit out incorrect values 20% of the time, or silently developed an opinion about the height of countertops. You'd not just have a structurally unsound plan, you'd also have a student who'd failed to learn anything useful.
> The critical difference between AI and a tool like a calculator, to me, is that a calculator's output is accurate, deterministic and provably true.
In current situation, by vibing and YOLOing most problems, we are losing the very ability we still need and can't replace with AI or other tools.
I think past successes have led to a category error in the thinking of a lot of people.
For example, the internet, and many constituent parts of the internet, are built on a base of fallible hardware.
But mitigated hardware errors, whether equipment failures, alpha particles, or other, are uncorrelated.
If you had three uncorrelated calculators that each worked 99.99% of the time, and you used them to check each other, you'd be fine.
But three seemingly uncorrelated LLMs? No fucking way.
This is why I differentiated "uncorrelated" from "seemingly uncorrelated." Sorry if that wasn't clear.
In point of fact, most technological revolutions have fairly immediately benefited a significant number of people in addition to those in the top 1% -- either by increasing demand for labor, or reducing the price of goods, or both.
The promise of LLMs is that they benefit people in the top 1% (investors and highly paid specialists) by reducing the demand for labor to produce the same stuff that was already being produced. There is an incidental initial increase in (or perhaps just reallocation of) labor to build out infrastructure, but that is possibly quite short-lived, and simultaneously drives a huge increase in the cost of electricity, buildings, and computer-related goods.
But the benefits of new technologies are never spread evenly.
When the technology of travel made remote destinations more accessible, it created tourist traps. Some well placed individuals and companies do well out of this, but typically, most people living near tourist traps suffer from the crowds and increased prices.
When power plants are built, neighbors suffer noise and pollution, but other people can turn their lights on.
We haven't yet begun to be able to calculate all the negative externalities of LLMs.
I would not be surpised if the best negative externality comparisons were to the work of Thomas Midgley, who gifted the world both leaded gasoline and CFC refrigerants.
I'm not saying this is ideal, but maybe there's another perspective to consider as well, which is lowering barriers to entry and increased ownership.
Many people can't/won't/don't do what it takes to build things, be it a house or an app, if they're starting from zero knowledge. But if you provide a simple guide they can follow, they might end actually building something. They'll learn a little along the way, make it theirs, and end up with ownership of their thing. As an owner, change comes from you, and so you learn a bit more about your thing.
Obviously whatever gets built by a noob isn't likely to be of the same caliber as a professional who spent half their life in school and job training, but that might be ok. DIY is a great teacher and motivator to continue learning.
Contrast to high barriers to entry, where nothing gets built and nothing gets learned, and the user is left dependent on the powers that be to get what he wants, probably overpriced, and with features he never wanted.
If you're a rocket surgeon and suddenly outsource all your thinking to a new and unpredictable machine, while you get fat and lazy watching tv, that's on you. But for a lot of people who were never going to put in years of preparation just to do a thing, vibing their idea may be a catalyst for positive change.
When slop becomes easier, there are a lot more people ready to push it to others than people that tries to produce guenuine work. Especially when theh are hard to distinguish superficially.
I fear for trying to get it to unlearn code from the last building code cycle when there's changes
The cash register says you owe $16.23, you give the cashier $21.28, and all hell breaks loose.
At other places, they take the $20, look confused, and fart around with the change for awhile.
On the other hand, our hard right has a trifecta of business, gun culture, and religion.
You're lacking the religion and gun culture, and trying to take away your health care would be the third rail, so in some respects, it would be difficult for you to follow us.
Also, without that trifecta, it seems that it would be somewhat more difficult to push the sort of anti-education agenda that gets pushed here, both at the university level and at lower levels (e.g. giving equal time to science and creationism).
You have to remember that the US was, in large part, founded by dogmatic malcontents who couldn't get along with their neighbors.
Can’t say the same for LLM. Our teachers were right with the internet of course as well. If you remember those early internet wild west school days, no one was using the internet to actually look up a good source. No one even knew what that meant. Teachers had to say “cite from these works or references we discussed in class” or they’d get junk back.
At first the internet was unreliable. Nobody could trust the information it gave you. So teachers insisted that students only use their trusted sources. But eventually the internet matured and now it would be seen as ridiculous for a teacher to tell a student not to do research on the internet.
Now replace "the internet" with "LLMs".
I graduated high school in '04 and even then I was only allowed to use this system called "Galileo" which was basically a curated listed of encyclopedic articles specifically meant for education and research.
No one is making cool shit for themselves. Everyone is held hostage ensuring Wall Street growth.
The "cross our fingers and hope for the best" position we find ourselves in politically is entirely due to labor capture.
The US benefited from a social network topology of small businesses. No single business being a lynch pin that would implode everything.
Now the economy is a handful of too big to fails eroding links between human nodes by capturing our agency.
I argued as hard as I could against shipping electronics manufacturing overseas so the next generation would learn real engineering skills. But 20 something me had no idea how far up the political tree the decision was made back then. I helped train a bunch of people's replacements before the telecom focused network hardware manufacturer I worked for then shut down.
American tech workers are now primarily cloud configurators and that's being automated away.
This is a decades long play on the part of aging leadership to ensure Americans feel their only choice is capitulate.
What are we going to do, start our own manufacturing business? Muricans are fish in a barrel.
And some pretty well connected people are hinting at similar sense of what's wrong: https://www.barchart.com/story/news/36862423/weve-done-our-c...
A certain group of people have something wrong with their brain where they can't be "educated" and are forced to learn by studying and such. The protagonist of the story is one of these people and feels ashamed at his disability and how everyone around him effortlessly knows things he has to struggle to learn.
He finds out (SPOILER) that he was actually selected for a "priesthood" of creative/problem solvers, because the education process gives knowledge without the ability to apply it creatively. It allows people to rapidly and easily be trained on some process but not the ability to reason it out.
The wikipedia entry also has link to the text but the above is nicer IMHO, just the raw text. From a previous HN discussion some weeks ago!
I'll add another analogy. I tell people when I tip I "round off to the nearest dollar, move the decimal place (10%), and multiply by 2" (generating a tip that will be in the ballpark of 18%), and am always told "that's too complicated". It's a 3 step process where the hardest thing is multiplying a number by 2 (and usually a 2 digit number...). It's always struck me as odd that the response is that this is too complicated rather than a nice tip (pun intended) for figuring out how much to tip quickly and with essentially zero thinking. If any of those three steps appear difficult to you then your math skills are below that of elementary school.
I also see a problem with how we look at math and coding. I hear so often "abstraction is bad" yet, that is all coding (and math) is. It is fundamentally abstraction. The ability to abstract is what makes humans human. All creatures abstract, it is a necessary component of intelligence, but humans certainly have a unique capacity for it. Abstraction is no doubt hard, but when in life was anything worth doing easy? I think we unfortunately are willing to put significantly more effort into justifying our laziness than we will to be not lazy. My fear is that we will abdicate doing worthwhile things because they are hard. It's a thing people do every day. So many people love to outsource their thinking. Be it to a calculator, Google, "the algorithm", their favorite political pundit, religion, or anything else. Anything to abdicate responsibility. Anything to abdicate effort.
So I think AI is going to be no different from calculators, as you suggest. They can be great tools to help people do so much. But it will be far more commonly used to outsource thinking, even by many people considered intelligent. Skills atrophy. It's as simple as that.
I tell people when I tip I "round off to the nearest dollar, move the decimal place (10%), and multiply by 2" (generating a tip that will be in the ballpark of 18%), and am always told "that's too complicated".
I would tell others to "shift right once, then divide by 2 and add" for 15%, and get the same response.
However, I'm not so sure what you mean by a problem with thinking that abstraction is bad. Yes, abstraction is bad --- because it is a way to hide and obscure the actual details, and one could argue that such dependence on opaque things, just like a calculator or AI, is the actual problem.
So, shift right twice? ;)
> Yes, abstraction is bad
No ifs, ands, or buts about it.
I'm sorry, I think you are teaching people the wrong thing if you are blanket statement saying "abstraction is bad". You are throwing the baby out with the bath water. You can "over abstract" and that certainly is not good but that's not easy to define as it is extremely problem dependent. But with these absurd blanket statements you just push code quality and performance down.
Over abstraction is bad because it can be too difficult to read or it can be bad because it de-optimizes programs. "Too difficult to read or maintain" is ultimately a skill issue. We don't let the juniors decide that but neither should we have abstraction where only wizards can maintain things. Both are errors.
But abstraction can also greatly increase readability and help maintain code. It's the reason we use functions. It's the reason we use OOP. It helps optimize code, it can help reduce writing, it can and does do many beneficial things.
Lumping everything together is just harmful.
Saying abstraction is bad is no different than saying "python is bad", or any duck typing language (including C++'s auto), because you're using an abstract data type. The "higher level" the language, the more abstract it is.
Saying abstraction is bad is no different than saying templates are bad.
Saying abstraction is bad is no different than saying object oriented programming is bad.
Saying abstraction is bad is saying coding is bad.
I'm sorry, literally everything we do is abstraction. Conflating "over abstraction" with "abstraction" is just as grave an error as the misrepresentation of Knuth's "premature optimization is the root of all evil." Dude said "grab a fucking profiler" and everyone heard "don't waste time making things work better".
If you want to minimize abstraction then you can go write machine code. Anything short of that has abstracted away many actions and operations. I'll admire your skill but this is a path I will never follow nor recommend. Abstraction is necessary and our ability to abstract is foundational into making code even work.
*I will die on this hill*
> because it is a way to hide and obscure the actual details
> one could argue that such dependence on opaque things, just like a calculator or AI, is the actual problem.
Actual knowledge about systems work much better more often than not, LLMs are not sentient and still need to be driven to get decent results.
If it gets stuck, use another LLM as the debugger. If that gets stuck then use another LLM. Turtles all the way down.
/s
(I don’t have the link to the video, but hopefully someone else remembers this joke)
that already happens today - they claim autocorrect or spell checks instead of ai previously.
I don't accept these as excuses as valid (even if it was real). It does not give them a valid out to change their mind regardless of the source of the text.
I agree that they make for poor excuses - but as generative content seeps into everything I fear it will become more commonly invoked.
yep, but invoking it doesnt force you to accept it. The only thing you get to control is your own personal choices. That's why i am telling you not to accept it, and i hope that people reading this will consider this their default stance.
> If you sent the mail, committed the code or whatever, you take responsibility for it. Anything else is just pathetic.
Have you discussed this with your therapist?
Unless we want to live in a world where accountability is optional, I think taking responsibility for your actions is the only choice.
And to be honest, today I don’t know where we stand on this. It seems a lot of people don’t care enough about accountability but then again a lot of people do. That’s just my take.
What I reacted to was blaming the LLM. "I am sorry,I meant like this ..." versus "it wasn't me, it was AI".
I've been speaking English as a second language since I was 12 but I completely overlooked one could use it that way. I guess they don't say it like that a lot in Hollywood, video games or... the internet.
Until now! :D
Thanks for explaining it :)
Implying mental health issues? That makes me think you were triggered by my comment.
"I was having a bad day, my mother had just died" is a very valid explanation for a poorly worded email. "It was AI" is not.
https://gwern.net/doc/fiction/science-fiction/2012-10-03-yva...
A criticism of the use of large language models (LLMs) is that it can deprive us of cognitive skills. Are some kinds of use are better than others? Andy Masley's blog says "thinking often leads to more things to think about", so we shouldn't worry about letting machines do the thinking for us — we will be able to think about other things.
My aim is not to refute all his arguments, but to highlight issues with "outsourcing thinking".
Masley writes that it's "bad to outsource your cognition when it:"
- Builds tacit knowledge you'll need in future.
- Is an expression of care for someone else.
- Is a valuable experience on its own.
- Is deceptive to fake.
- Is focused in a problem that is deathly important to get right, and where you don't totally trust who you're outsourcing it to.
How we choose to use chatbots is about how we want our lives and society to be.
That's what he has to say. Plus some examples, which help make the message concrete. It's a useful article if edited properly.
(This comment could also be shortened to “that’s oversimplifying”. I think my longer version is both more convincing and enjoyable.)
That makes for a tough discussion unfortunately. I see a lot of value lost by having LLMs in email clients, and I dont observe the benefit; LLMs are a net time sink because I have to rewrite its output myself anyway. Proponents seem to not see any value loss, and they do observe an efficiency gain.
I am curious to see how the free market will value LLM communication. Will the lower quality, higher quantity be a net positive for job seekers sending applications or sales teams nursing leads? The way I see it either we end up in a world where eg job matching is almost completely automated, or we find an effective enough AI spam filter and we will be effectively back to square one. I hope it will be the latter, because agents negotiating job positions is bound to create more inequality, with all jobs getting filled by applicants hiring the most expensive agent.
Either way, so much compute and human capital will go wasted.
You get to start by dumping your raw unfiltered emotions into the text box and have the AI clean it up for you.
If you're in customer support, and have to deal with dumbasses all day long who are too stupid to read the fucking instructions. I imagine being able to type that out, and then have the AI remove profanity and not insult customers to be rather cathartic. Then, substitute "read the manual" for an actually complicated to explain thing.
Anyone semi-literate can write down what they're feeling.
It's sometimes called "journaling".
Thinking through what they've written, why they've written it, and whether they should do anything about it is often called "processing emotions."
The AI can't do that for you. The only way it could would be by taking over your brain, but then you wouldn't be you any more.
I think using the AI to skip these activities would be very bad for the people doing it.
It took me decades to realize there was value in doing it, and my life changed drastically for the better once I did.
The meat there is when not to use an LLM. The author seems to mostly agree with Masley on what's important.
It's a dismissive as a spitting in someone's face.
Google AI describes it as:
This is the most common form, often used in debates about technology, immigration, or retirement.
Definition: The belief that there is a set, finite amount of work to be done in an economy.
The Fallacy: Assuming that if one person works more, or if a machine does a job, there is less work left for others.
Reality: An increase in labor or technology (like AI or automation) can increase productivity, lower costs, and boost economic activity, which actually creates more demand for labor.
Examples:
"If immigrants come to this country, they will take all our jobs" (ignoring that immigrants also consume goods and create demand for more jobs).
"AI will destroy all employment" (ignoring that technology typically shifts the nature of work rather than eliminating it).Notice something subtle.
Early inventions extend coordination. Middle inventions extend memory. Later inventions extend reasoning. The latest inventions extend agency.
This suggests that human history is less about tools and more about outsourcing parts of the mind into the world.
Intellect is not the same thing as volition.
Two questions...
1. Do you think it's impossible for AI to have it's own volition?
2. We don't have full control over the design of AI. Current AI models are grown rather than fully designed, the outcomes of which are not predictable. Would you want to see limits placed on AI until we had a better grasp of how to design AI with predictable behaviour?
Sign me up for this utopia.
Working in this manner, it is so painfully clear it doesnt really follow the flow of the article even. It misses on so many critical details and just sorta fills in its own blanks wrong... When you tell it that its missing a critical detail, it treats you like some genius, every single time.
It is hard for me to try to imagine growing up with it, and using it to write my own words for me. The only time i copy paste words to a fellow human that is ai generated, is for totally generic customer service style replies, for questions i dont totally consider worthy of any real time.
AI has kinda taken away my flow state for coding, rare as it was... I still get it when writing stuff I am passionate about, and I can't imagine I'll ever wanna outsource that.
Yeah, or as I say, Uriah Heep.
To be fair, telling everybody they are geniuses is the obvious next step after participation awards.
Because people have figured out that participation awards are worthless, so let's give them all first place.
I have been reminded constantly throughout this that a very large fraction of people are easily impressed by such prose. Skill at detecting AI output (in any given endeavour), I think, correlates with skill at valuing the same kind of work generally.
Put more bluntly: slop is slop, and it has been with us for far longer than AI.
Applying this analogy to human relationships - neocortex allowed us to be more social. Social communication with limbic system was mostly "you smell like a member of our species and I want to have sex with you". So having neocortex expanded our social skills to having friends etc.
I think AI will have a similar effect. It will allow us to individually communicate with large amount of other people (millions). But it will be a different relationship than what we today call "personal communication", face to face, driven by our neocortex. It will be as incomprehensible for our neocortex as our language is incomprehensible for the limbic system.
To his point: personally, I find it shifts 'where and when' I have to deal with the 'cognitive load'. I've noticed (at times) feeling more impatient, that I tend to skim the results more often, and that it takes a bit more mental energy to maintain my attention..
The things that are actually dangerous in our lives? Not informing ourselves enough about science, politics, economics, history, and letting angry people lead us astray. Nobody writes about that. Instead they write about spooky things that can't be predicted and shudder. It's easier to wonder about future uncertainty than deal with current certainty.
What's more, that's not fundamentally a new thing, it's always been possible for someone to helplessly cling to another human as their brain... but we've typically considered that to be a mental-disorder and/or abuse.
Here's another cooking example: try to look up a recipe right now. It should contain meat, veggies, fiber. What will you get? A recipe that is generic and tailored to the masses in your general location. It's genuinely hard to find a recipe for food that isn't extremely familiar to the culture assigned to you (even if you're actually 1st generation Chinese, if you're browsing from Ohio with Google using English language, you aren't gonna get authentic Chinese dishes back). Because whatever system of systems is looking up recipes for you, is designed to do that; to think for you, and provide you a set of basic, canned responses.
The entire world is that. Nearly every part of our world, we abdicate. Our decisions are not really ours; they're a constructed set of possible decisions defined by other people, programmed into our brains by osmosis. And you go with it, because otherwise the world would be too hard to deal with.
This causes you to not only "lose" information and skills people had in the past, it defines who you are now and what you do. And it's been happening since civilization started. Actually before, since it's about your ecosystem, and systems of systems. AI is now a part of our ecosystem and will define who we are, and we don't really have a choice in the matter, because it's systemic.
That's a very low bar. I expect most people know how to cook, at least simple dishes.
Some people really don't.
It seems wild to me to assume most people on HN don't know how to cook even basic stuff...
This ties with how I sometimes describe current generation AI as a form of mechanized intelligence: like Babbage’s calculating machine, but scaled up to be able to represent all kinds of classes of things.
And in this perspective that I’m circling these days where I’m currently coming down on it is maybe the effect of this realization will be something like the dichotomy outlined in the Dune series: namely, that between mechanized intelligence embodied by mentats and the more intuitive and prescient aspects of cognition embodied by the Benni Jessarit and Paul’s lineage.
A simple but direct way to describe this transition in perspective may be that we come to see what we formally thought of as intelligence in the West/reductive tradition as a form of mechanized calculation that it’s possible to outsource to automatic non-biological processes, and we start to lean in more deeply to the more intuitive and prescient aspects of cognition.
One thing I’m reminded of is how Indian yogic texts describe various aspects of mind.
I’m not sure if it’s a one-to-one mapping because I’m not across that material but merely the idea of distinguishing between different aspects of mind is something with precedent; and central to that is the idea of removing association between self identity and the aspects of mind.
And so maybe one of the effects for us as a society will be something akin to that.
Apparently he think of planning a vacation as some artistic expression.
It all comes down to people who have comfort in their own workflows and it takes mental load to change it. And then find reasons to work backwards to justify not liking AI.
The article he references gives this example:
“Is it lazy to watch a movie instead of making up a story in your head?”
Yes, yes it is, this was a worry when we transitioned from oral culture to written culture, and I think it was probably prescient.
For many if not most people cultural or technological expectations around what skills you _have_ to learn probably have an impact on total capability. We probably lost something when Google Maps came out and the average person didn’t have to learn to read a map.
When we transitioned from paper and evening news to 24 hour partisan cable news, I think more people outsourced their political opinions to those channels.
Even in my mid 30s I see this issue with people around my age. Even for local areas, it seems like no one really understands what direction they are heading, they just kinda toggle on the GPS and listen for what to do... forever?
On pretty much every modern GPS, there is a button to show the full route instead of the current step the user is on(as well as keeping it in a static orientation). I feel like just that being the default most of the time, would help a ton of people.
That's the risk involved with opinions and conclusions.
When it comes to what we believe, humans see what they want to see. In other words, we have what Julia Galef calls a soldier mindset. From tribalism and wishful thinking, to rationalizing in our personal lives and everything in between, we are driven to defend the ideas we most want to believe--and shoot down those we don't. But if we want to get things right more often, argues Galef, we should train ourselves to have a scout mindset. Unlike the soldier, a scout's goal isn't to defend one side over the other. It's to go out, survey the territory, and come back with as accurate a map as possible. Regardless of what they hope to be the case, above all, the scout wants to know what's actually true. In The Scout Mindset, Galef shows that what makes scouts better at getting things right isn't that they're smarter or more knowledgeable than everyone else. It's a handful of emotional skills, habits, and ways of looking at the world--which anyone can learn. With fascinating examples ranging from how to survive being stranded in the middle of the ocean, to how Jeff Bezos avoids overconfidence, to how superforecasters outperform CIA operatives, to Reddit threads and modern partisan politics, Galef explores why our brains deceive us and what we can do to change the way we think.
Cogito, ergo sum
The corollary is: absence of thinking equals non-existence. I don't see how that can be an improvement. Improvement can happen only when it's applied to the quality of people's thinking.
(And that's not what the Cogito means in the first place. It's a statement about knowledge: I think therefore it is a fact that I am. Descartes is using it as the basis of epistemology; he has demonstrated from first principles that at least one thing exists.)
> Plenty of things exist without thinking.
Existence in an animal farm isn't human existence.
I hate this take, computer code is just as rich in personality as writing. I can tell a tremendous amount about what kind of person someone is solely based off their code. Code is an incredibly personal expression of ones mental state, even if you might not realize it. LLMs have dehumanized this and the functional outcomes become FAR more unpredictable.
If outsourcing thought is beneficial, those who practice it will thrive; if not, they will eventually cease to practice it, one way or another.
Thought, as any other tool, is useful when it solves more problems than it creates. For instance, an ability to move very fast may be beneficial if it gets you where you want to be, and detrimental, if it misses the destination often enough, and badly enough. Similarly, if outsourced intellectual activities miss the mark often enough, and badly enough, the increased speed is not very helpful.
I suspect that the best results would be achieved by outsourcing relatively small intellectual acts in a way that guarantees very rare, very small errors. That is, AI will become useful when AI becomes dependable, comparable to our other tools.
I suspect that outsourcing thinking may reflect on quite some outcomes, too. We just need time to gather the statistics.
It makes them prey to and dependent on those who are building and selling them the thinking.
> I suspect that the best results would be achieved by outsourcing relatively small intellectual acts in a way that guarantees very rare, very small errors. That is, AI will become useful when AI becomes dependable, comparable to our other tools.
That's like saying ultra processed foods provide the best results when eaten sparingly, so it will become useful when people adopt overall responsible diets. Okay, sure, but what does that matter in practice since it isn't happening?