Don't dismiss this superpower you have in your own head.
1) They have access to a vast array of extremely well indexed knowledge and can tell me about things that I'd never have found before.
2) They are able to respond instantly and engagingly, while working on any topic, which helps fight fatigue, at least for me. I do not know how universal this effect is, but using them often means that I can focus for longer. I can also make them do drudgery, like refactoring 500 functions in mostly the same way that is just a little bit too complicated for deterministic tools to do, which also helps with fatigue.
Ideally, they'd also give you a more unique perspective or push-back when appropriate, but they are yes-men too much right now for that to be the case.
Lastly, I am not arguing to not do private thinking too. My argument is that LLM-involved thinking is useful as its own thing.
The advantages that you listed make them worth it.
This is not new, as LLMs root are statistics, data compression with losses, It is statistically indexed data with text interface.
The problem is someones are selling to people this as the artificial intelligence they watched at movies, and they are doing it deliberately, calling hallucinations to errors, calling thinking to keywords, and so on.
There is a price to pay by the society for those fast queries when people do not verify such outputs/responses, and, unfortunately, people is not doing it.
I mean, it is difficult to say. When I hear some governments are thinking in to use LLMs within the administrations I get really concerned, as I know those outputs/responses/actions will nor be revised nor questioned.
I still have a lot of my best ideas in the shower, no paper and pen, no LLM to talk to. But writing them down is the only way to iron out all the ambiguity and sort out what’s really going to work and what isn’t. LLMs are a step up from that because they give you a ready-made critical audience for your writing that can challenge your assumptions and call out gaps and fuzziness (although as I said in my other comment, make sure you tell them to be critical!)
Thinking is great. I love it. And there are advantages to not involving LLMs too early in your process. But it’s just a first step and you need to write your ideas down and submit them to external scrutiny. Best of all for that is another person who you trust to give you a careful and honest reading, but those people are busy and hard to find. LLMs are a reasonable substitute.
10 You recognise your thinking (or some other desirable activity) has improved
20 You're excited about it
30 You engage more with the thinking (or other activity)
40 You get even better results
50 Even more excitement
60 GOTO 30
No they don’t hallucinate that much.
Since paper this is one of the most important inventions. It has almost infinite knowledge and you can ask it anything mostly.
You're absolutely right!
On a more serious note, if it has almost infinite knowledge, is it even a cognitive-offloading tool in the same class as paper? Sounds more like something designed to stifle and make my thoughts conform to its almost infinite knowledge.
edit: I'll admit ChatGPT is a great search engine (and also very hallucinatory depending on how much you know about the subject) and maybe it helps some people think, sure. But beyond a point I find it actually harmful as a means to develop my own ideas.
I think chatbots are a very clumsy way to get information. Conversations tend to be unfocused until you, the human, take an interest in something more specific and pursue it. You're still doing all the work.
It's also too easy to believe in the hype and think it's at least better than talking to another person with more limited knowledge. The fact is talking has always sucked. It's slow, but a human is still better because they can deduce in ways LLMs never will. Deduction is not mere pattern matching or correlation. Most key insights are the result of walking a long tight rope of deductions. LLMs are best at summarizing and assisting with search when you don't know where to start.
And so we are still better off reading a book containing properly curated knowledge, thinking about it for a while, and then socializing with other humans.
I have had conversations and while they don’t have the exact attentiveness of a human, they get pretty close. But what they do have an advantage in is being an expert in almost any field.
LLMs are Bayesian inference and come with all its baggage. We definitely know brains are way better than that, even of other animals or insects.
Ultimately, there's no point in getting a chatbot to say deceptively expert-like words that are guaranteed by design to be lower quality than the books or blogs it learned from. LLMs are at best a search tool for those sources, and investor attitude now reflects that sanity with their confidence shifting back over to Google's offerings. Agentic AI is also pretty weak since agents are as functionally limited as any traditionally written computer program, but lacking the most crucial property of repeatability.
I find it shocking how many people didn't see this whole thing as a grift from day one. What else was SV going to do during the post-covid economic slump?
I've seen people solve their own issues by asking me / telling me about something and finding the solution without me having the time to reply numerous times.
Just articulating your thoughts (and using more of your brain on them by voicing them) helps a lot.
Some talk to themselves out loud and we are starting to realize it actually helps.
I've seen multiple cases of... inception. Someone going all in with ChatGPT and what not to create their strategy. When asked _anything_ about it, they defended it as if they came up with it, but could barely reason about it. Almost as if they were convinced it was their idea, but it really wasn't. Weird times.
Indeed, people trying to write prompts for the chatbots and continuously iterating on making their prompts clearer / more effective at conveying their needs is an exercise many haven't done since highschool. Who would've thought that working on your writing and reading proficiency may improve your thinking.
I’m glad LLMs help these people. But I’m not gonna trade society because a subset of people can’t write things down.
Maybe read up on what having an "inner voice" or not actually does first? Before making, frankly, weird and unfounded takes on the subject.
Why are you asking other people to read up on something you clearly haven't read up on yourself?
Simply, when thinking hits a wall, we can now consult a machine via conversation interface lacking conventional human social biases. That is a new superpower.