I doubt the whole concept of calling it "thinking" or "reasoning". If it's automated context engineering, call it that. The bullshit is in the terms used.
303 karma · joined October 27, 2023
I doubt the whole concept of calling it "thinking" or "reasoning". If it's automated context engineering, call it that. The bullshit is in the terms used.
Yes, they clearly are not bullshitting. They would be bullshitting if they would tell me that the LLM "thinks" while helping them.
Autocompletion and inline documentation was a godsend at their time. It solved the particular hard and heavy problem of kilos of manuals. It was a technical solution to a problem just like LLMs.
Don't get me wrong, it's a fascinating and extremely dangerous technology but it's clearly over-hyped.
Disclaimer: I’m no expert. An anecdotal example: I asked the reasoning LLM a question, and it laid out the correct answer in its thinking step, only to stop thinking and confidently give the wrong answer. That moment led me to conclude that when LLM evangelists talk about reasoning and thinking, they are essentially bullshitting.
Sure they are. I'm not interested in how difficult this is for a LLM. This is not the question. Go out there, get the information. That this is hard for a LLM proves the point: They are surprisingly bad at some simple tasks.
> Try learning programming.
I started programming in the early 1980's.
No. I'm standing in front of the dishwasher and the dishwasher expects me to tell it in detail how to wash the dishes.
This is not about if you can find any use for a LLM at all. This is about:
> LLMs are still surprisingly bad at some simple tasks
And yes. They are bad if you have to hand feed them each and every detail for an extremely simple task like comparing two lists.
You even have to debug the result because you cannot be sure that the dishwasher really washed the dishes. Maybe it just said it did.
Ok, I only have to:
1. Generally solve the problem for the AI
2. Make a step by step plan for the AI to execute
3. Debug the script I get back and check by hand if it uses reliable sources.
4. Run that script.
For what do I need the AI?
How would you solve that problem? You'd probably go to the internet, get the list of TLDs and the list of HTML5-Element and than compare those lists.
The author compares three commercial large‑language models that have direct internet access, but none of them appear capable of performing this seemingly simple task. I think his conclusion is valid.
I'm interested in this as well. I currently use fzf and I'm happy with what I've got (except for me syncing would probably be a nice feature to have).
Also: I gave atuin a quick try and found the TUI to be worse than fzf. Why do I need a fullscreen ctrl-r interface? I found that distracting. But maybe that is configurable. I didn't look much further.
If you truly believe in the potential of agentic AI, then the logical conclusion is that programming languages will become the assembly languages of the 21st century. This may or may not become the unfortunate reality.
> Compared to non-users, non-medical cannabis use was significantly associated with 96% decreased odds of SCD (aOR=0.04, 95% CI=0.01-0.44, p<.01). Medical (aOR=0.46, 95% CI=0.06-3.61, p=.46) and dual medical and non-medical use (aOR=0.30, 95% CI=0.03-2.92, p=.30) were also associated with decreased odds of SCD, although not significant.
I'm not a native speaker but if non-medical use of cannabis has a different outcome than medical and mixed use than it seems plausible that there are other - more important - factors at play or do I misunderstand the paragraph?
???
I recently started learning Common Lisp for fun (and fun it is!) and the ease of accessing C libraries was one of the things that surprised me in a positive way.
Using https://github.com/rpav/cl-autowrap one can simply write (c-include "file.h") and the API defined in "file.h" is accessible from Lisp. I can't think of a simpler way.
Even without cl-autowrap, FFI using https://cffi.common-lisp.dev/ seems simple enough.