Please don't mention AI again
ludic.mataroa.blog
ludic.mataroa.blog
I think one of the results of this is that the concept of AI itself increasingly becomes more muddled until it becomes indistinguishable from a word like “technology” and therefore useless for describing a particular phenomenon. You can already see this with the usage of “AGI” and “super intelligence” which from the definitions I’ve been reading, are not the same thing at all. AGI is/was supposed to be about achieving results of the average human being, not about a sci-fi AI god, and yet it seems like everyone is using them interchangeably. It’s very sloppy thinking.
Instead I think the term AI is going to slowly become less marketing trendy, and will fade out over time, as all trendy marketing terms do. What will be left are actually useful enhancements to specific use cases - most of which will probably be referred to by a word other than AI.
What happened to ML? With the relatively recent craze precipitated by chatgpt, the term AI (perhaps in no small part due to "OpenAI") has completely taken over. ML is a more apt description of the current wave.
Eventually ML got pretty good and a lot of the industry forgot the AI winter, so we're calling it AI again because it sounds cooler.
AI is a science ML is just one of the areas of this science
Look at the google engineer who thought they had an AI locked up in the basement... https://www.theverge.com/2022/6/13/23165535/google-suspends-...
MS paper on sparks of AGI: https://www.microsoft.com/en-us/research/publication/sparks-...
The rumors that OpenAI deal with MS would give them everything till they got to AGI... A perpetual license to all new development.
All the "Safety people" have left the OpenAi building. Even musk isnt talking about safety any more.
I think the bet was that if you fed an LLM enough, got it big enough it would hit a tipping point, and become AGI, or sentient or sapient. That lines up nicely with the MS terms, and MS's on paper.
I think they figured out that the math doesn't work that way (and never was going to). A prediction of the next token being better isnt intelligence any more than weather prediction will become weather.
Why? I think it absolutely can be intelligence.
The alternative I'm considering is that It might just be that it's just a dataset problem, feeding these llms on words makes the lack a huge facet of embodied axistance that is needed to get context.
I am a nobody though, so who knows....
They do seem to do generalisation, to at least some degree.
If it was literal memorisation, we do literally have internet search already.
Right now they are limited by the context, but that's probably a temporary limitation.
("You think before you speak". That thinking of course does not stop at "sounding" proper - it has to be proper in content...)
If an LLM can predict the next word without doing a critical evaluation, then it raises the question of what the intelligent people are doing. They might not be doing a critical evaluation at all.
Well certainly: in the mind ideas can be connected tentatively by affinity, and they become hypotheses of plausible ideas, but then in the "intelligent" process they are evaluated to see if they are sound (truthful, useful, productive etc.) or not.
Intelligent people perform critical evaluation, others just embrace immature ideas passing by. Some "think about it", some don't (they may be deficient in will or resources - lack of time, of instruments, of discipline etc.).
And who says LLM are not able to do that (eventually)?
They are not _good_ at it right now, and they are totally bad at making generalizations. But who says it's not just an artifact of the limited context?
… but it's still a brain the size of a mouse's.
Don't get me wrong, organic brains learn from far fewer examples than AI, there's a lot organic brains can do that AI don't (yet), but I don't really find the intellectual capacity of mice to be particularly interesting.
On the other hand, the question of if mice have qualia, that is something I find interesting.
Mediocre, or even excellent, Python and rap lyrics in Latin are easy stuff, just like chess and arithmetic. Humans just are really bad at them.
https://www.televisual.com/news/behind-the-scenes-spy-in-the....
Isn't this distinction more about "language" than "intelligence". There are some fantastically intelligent animals, but none of them can do the tasks you mention because they're not built to process human languages.
But this is besides the point; I have no doubt that if one were to make a mouse immortal and give it 50,000 years experience of reading the internet via a tokeniser that turned it into sensory nerve stimulation and it getting rewards depending on how well it can guess the response, it would probably get this good sooner simply because organic minds seem to be better at learning than AI.
But mice aren't immortal and nobody's actually given one that kind of experience, whereas we can do that for machines.
Machines can do this because they can (in some senses but not all) compensate for the sample-inefficient by being so much faster than organic synapses.
In terms of spoken language they are limited, but they surprise me all the time with terms they have picked up over the years. They can definitely associate a lot of words correctly (if it interests them) that we didn't train them with at all, just by mere observation.
A LLM associates bytes with other bytes very well. But it has no notion of emotion, real world actions and reactions and so on in relation to those words.
A thing that dogs are often way better than even humans is reading body language and communicating through body language. They are hyper aware of the smallest changes in posture, movement and so on. And they are extremely good at communicating intent or manipulate (in a neutral sense) others with their body language.
This is a huge, complex topic that I don't think we really fully understand, in part because every dog also has individual character traits that influence their way of communicating very much.
Here's an example of how complex their communication is. Just from yesterday:
One of our dogs is for some reason afraid of wind. I've observed how she gets spooked by sudden movements (for example curtains at an open window).
Yesterday it was windy and we went outside (off leash in our yard), she was wary and showed subtle fear and hesitated to move around much. The other dog saw that and then calmly got closer to her, posturing towards the same direction she seemed to go. He made small very steps forward, waited a bit, let her catch up and then she let go of the fear and went sniffing around.
This all happened in a very short amount of time, a few seconds, there is a lot more to the communication that would be difficult and wordy to explain. But since I got more aware of these tiny movements (from head to tail!) I started noticing more and more extremely subtle clues of communication, that can't even be processed in isolation but typically require the full context of all movements, the pacing and so on.
Now think about what the above example all entails. What these dogs have to process, know and feel. The specificity of it, the motivations behind it. How quickly they do that and how subtle their ways of communications are.
Body language is a large part of _human_ language as well. More often than not it gives a lot of context to what we speak or write. How often are statements misunderstood because it is only consumed via text. The tone, rhythm and general body language can make all the difference.
But you should find their self-direction capacity incredible and their ability to instinctively behave in ways that help them survive and propagate themselves. There isn't a machine or algorithm on earth that can do the same, much less with the same minuscule energy resources that a mouse's brain and nervous system use to achieve all of that.
This isn't to even mention the vast cellular complexity that lets the mouse physically act on all these instructions from its brain and nervous system and continue to do so while self-recharging for up to 3 years and fighting off tiny, lethal external invaders 24/7, among other things it does to stay alive.
All of that in just a mouse.
No, why would I?
Depending on what you mean by self-direction, that's either an evolved trait (with evolution rather than the mouse itself as the intelligence) for the bigger picture what-even-is-good, or it's fairly easy to replicate even for a much simpler AI.
The hard part has been getting them to be able to distinguish between different images, not this kind of thing.
> and their ability to instinctively behave in ways that help them survive and propagate themselves. There isn't a machine or algorithm on earth that can do the same,
https://en.wikipedia.org/wiki/Evolutionary_algorithm
> much less with the same minuscule energy resources that a mouse's brain and nervous system use to achieve all of that.
Is nice, but again, this is mixing up the intelligence of the animal with the intelligence of the evolutionary process which created that instance.
I as a human have no knowledge of the evolutionary process which lets me enjoy the flavour of coriander, and my understanding of the Krebs cycle is "something about vitamin C?" rather than anything functional, and while my body knows these things it is unconventionable to claim that my body knowing it means that I know it.
The evolutionary processes behind the mouse being capable of all that are a part of the long distant past, up to the present, and their results are manifest in the physiology and cognitive abilities (such as they are) of the mouse), but this means that these abilities, conscious, instinctive and evolutionary only exist in the physical body of that mouse and nowhere else. No man-made algorithm or machine is capable of anything remotely comparable and its capacity for navigating the world is nowhere near as good. Once again, this especially applies when you consider that the mouse does all it does using absurdly tiny energy resources, far below what any LLM would need for anything similar.
(Why spend a mouse? Just sit a strawberry in a library, and if the hypothesis holds that the quantity of data is the only thing that matters holds, you'll have a super intelligent strawberry)
That's the question though, do they? One way of looking at gen AI is as a highly efficient compression and search. WinRAR doesn't learn, neither does Google - regardless of the volume of input data. Just because the process of feeding more data into gen AI is named "learning" doesn't mean that it's the same process that our brains undergo.
“God sleeps in the rock, dreams in the plant, stirs in the animal, and awakens in man.” ― Ibn Arabi
Gradually, as these LLM next-token predictors are set up recursively, constructively, dynamically, and with the right inputs and feedback loops, the limitations of the fundamental building blocks become less important. Might take a long time, though.
The version of emergence that AI hypists cling to isn't real, though, in the same way that adding more NAND gates won't magically make the logic function you're thinking about. How you add the NAND gates matters, to such a degree that people who know what they're doing don't even think about the NAND gates.
There are infinitely more wrong and useless circuits than there are the ones that provide the function you want/need.
An algorithm that can reason about the meaning of text probably isn't in the state space of GPT. Thanks to the https://en.wikipedia.org/wiki/Universal_approximation_theore..., we can get something that looks pretty close when interpolating, but that doesn't mean it can extrapolate sensibly. (See https://xkcd.com/2048/, bottom right.) As they say, neural networks "want" to work, but that doesn't mean they can.
That's the hard part of machine learning. Your average algorithm will fail obviously, if you've implemented it wrong. A neural network will just not perform as well as you expect it to (a problem that usually goes away if you stir it enough https://xkcd.com/1838/), without a nice failure that points you at the problem. For example, Evan Miller reckons that there's an off-by-one error in everyone's transformers. https://www.evanmiller.org/attention-is-off-by-one.html
If you add enough redundant dimensions, the global optimum of a real-world gradient function seems to become the local optimum (most of the time), so it's often useful to train a larger model than you theoretically need, then produce a smaller model from that.
> But isn't that what the training algorithm does?
It's true that training and other methods can iteratively trend towards a particular function/result. But in this case the training is on next token prediction which is not the same as training on non-verbal abstract problem solving (for example).
There are many things humans do that are very different from next token prediction, and those things we do all combine together to produce human level intelligence.
Exactly LLMs didn't resolve knowledge representation problems. We still don't know how it's going in our brains, but at least we know, we may do internal symbolic knowledge representation and reasoning. LLMs don't. We need a kind of different math for ANNs, a new convolution but for text where layers extract features through the lexical analysis and ontology utilisation, and then train the network.
You say emergence is a real thing, and it is, but we have not one single example of it taking the form of sentience in any human-created thing of complexity.
It's cyclical. The term "ML" was popular in the 1990s/early 2000s because "AI" had a bad odor of quackdom due to the failures of things like expert systems in the 1980s. The point was to reduce the hype and say "we're not interested in creating AGI; we just want computers to run classification tasks". We'll probably come up with a new term in the future to describe LLMs in the niches where they are actually useful after the current hype passes.
Maybe if you go by article titles it has. If you look at job titles, there are many more ML engineers than AI engineers.
Well for one, five years ago, anyone doing machine learning was doing their own training -- you know, overseeing the actual learning part. Now, although there is learning involved in LLMs, you as the consumer aren't involved in that part. You're given API access (or at best a set of pre-trained weights) as a black box, and you do what you can with it.
new math for knowledge based systems <- ANN <- ML <- KRR <- LMM's
It's obvious BS from anyone in tech, but the people throwing money aren't in tech.
>I think the term AI is going to slowly become less marketing trendy, and will fade out over time, as all trendy marketing terms do. What will be left are actually useful enhancements to specific use cases - most of which will probably be referred to by a word other than AI.
it'll die down, but the marketing tends to stick, sadly. we'll have to deal with if AI means machine learning or LLMs or video game pathfinding for decades to come.
They're still on r/Metaverse_blockchain. Every day, a new "meme coin". Just in:
"XXX - The AI-Powered Blockchain Project Revolutionizing the Crypto World! ... Where AI Meets Web3"
"XXX is an advanced AI infrastructure that develops AI-powered technologies for the Web3, Blockchain, and Crypto space. We aim to improve the Web3 space for retail users & startups by developing AI-powered solutions designed explicitly for Web3. From LLMs to Web3 AI Tools, XXX is the go-to place to boost your Web3 flow with Artificial Intelligence."
This is a synergistic, paradigm-shifting piece of content that leverages cutting-edge, scalable innovation to deliver a robust, value-added user experience. It epitomizes next-gen, mission-critical insights and exemplifies best-in-class thought leadership within the dynamic ecosystem
It's only now that everybody's used to natural language interfaces that I think we're becoming far less forgiving of things like this nonsense:
---
- "How do I do (x)."
- "You do (A)."
- "No, that's wrong because reasons."
- "Oh I'm sorry you're 100% right. Thank you for the correction. I'll keep that in mind in the future. You do (B)."
- "No that's also wrong because reasons."
- "Oh I'm sorry you're 100% right. Thank you for the correction. I'll keep that in mind in the future. You do (A)."
- #$%^#$!!#$!
---
"No."
Sort of, kind of. Those natural language interfaces that Actually Work aren't even 2 years old yet, and in that time there weren't many non-shit integrations released. So at best, some small subset of the population is used to the failure modes of ChatGPT app - but at least the topic is there, so future users will have better aligned expectations.
Siri. Introduced 2011.
Before that...
Q&A Database, the product that Symantec was founded to sell. Released 1985.
https://en.wikipedia.org/wiki/Q%26A_(Symantec)
Before that...
The Infocom adventure game parser.
https://www.ifwiki.org/Infocom-type_parser
Infocom was founded in 1979.
https://en.wikipedia.org/wiki/Infocom
Before that...
SHRDLU, 1968.
https://en.wikipedia.org/wiki/SHRDLU
Before that...
ELIZA? (1964)
Not working well to this day. Siri is mostly a joke and a meme, much like Alexa, Cortana and Google whatever-they-call-it-now.
Other stuff: yeah, you can get away with a lot using some formal grammar, a random number generator, and a lot of effort railroading the user so they won't even think to say anything that'll break the illusion. I've had people not realize for weeks that my IRC bot is a bot, even if all it did was apply a bunch of regular exceptions to input (the trick was that the bot would occasionally speak unprompted and react to other people's conversations, and replied to common emoticons and words indicating emotion).
No, only in the last two years we can say that there exist Speech-to-Text that works reliably, Text-to-Speech that sounds natural, and a ML model that can parse arbitrary natural language text and reliably infer what you want, even if you never directly stated what you want, and handling for it was never explicitly coded.
I think you are presenting a gradual incremental change as some sort of binary transition, and it isn't. This is at best disingenuous and misleading and at worst it's a flat out lie.
Text-only natural language interfaces were working in the 1960s and working well by the 1980s.
Live real-time speech recognition with training was working by the turn of the century, and following a hand injury, I was dictating my work into freeware for a while by 2000 or so. It was bundled with later versions of IBM OS/2 Warp.
Real-time speaker-independent speech recognition started working usefully well some 15 years ago, and even as a sceptic who dislikes such things, I was using it and demonstrating it a decade ago. It's been a standard feature of mainstream commercial desktop OSes as well as smartphones for about 8-9 years. Windows 10 (2015) included Cortana; macOS Sierra (2016) included Siri.
In fact, after I posted my previous comment, this morning Facebook reminded me that 8Y ago today I was installing Win10 on my Core 2 Duo Thinkpad.
I don't allow any of these devices in my home but they're a multi-billion dollar in domestic voice-controlled hardware.
This is mainstream used by a double-digit percentage of humanity.
You seem to have been deceived by the LLM bot fakery of "intelligence" that it's achieved some quantum leap in smarts recently. This is illusory.
1) Most recent breed of ML models, backed in part by LLMs;
2) A voice control system I hacked together some 17 years ago, with Microsoft Speech API and a cheap microphone I soldered to a long cable and stuck to the side of the wardrobe. It had the benefit of using a fixed grammar tree, and it was in the saner time when the vendor actually allowed you to train the system on your own texts.
Everything else - especially current voice assistants and dictation software on the couple flagship phones I've used over the years - was garbage compared to that.
So again, I must be the unluckiest person in the world when it comes to voice recognition, because what you wrote is entirely counter to my experience.
I'm talking about what I see in the world. The people who own Apple watches and iPhones who rarely even take the phone out of their pocket/bag any more. The folks whose light switches are never used or who are even getting them removed. The people who don't use things like kitchen timers any more. The disappearance of physical or local music/video collections.
I think these trends are observable and widespread.
Me? I don't go near any of them, myself.
Eh, I know an anecdote isn't a statistic, but my experience with voice controls is so bad that I've mostly gotten rid of the "smart" parts and gone back to the light switches.
Back when we had Alexa, we'd say "Alexa, Küche aus" ("kitchen off") and it would reply "Ich kann nicht 'Küche' im Spotify finden" (worse, we didn't have Spotify).
Siri is less bad, but it still just randomly fails. I've had two devices in the same room try to respond to the same voice command, one succeeds and the other spins around for a bit and responds with a spoken generic error.
For the voice input keyboard, the error rate is much worse, bad enough that in my experience I might as well have typed one real word and let autosuggest write the remainder of whatever I was not-typing.
I have watched my friends with this kit demonstrate it to me, many times, and to me it seems clumsy and difficult and error-prone, as well as being expensive, vastly horribly insecure and not so much violating privacy as gang-raping it.
I do not understand why they like it or think it better.
The only friend I know with a valid use case is non-light-sensing blind. It's useful for him to just tell the room "turn the lights off" rather than hunt for the switch. Or ask if they're on.
(Yes he has lights. He's married with a kid.)
Agreed, but I think we'll soon start to discover that interacting with systems as if they were text adventure games of the 80's is also going to get pretty weird and frustrating, not to mention probably inefficient.
If you tell ChatGPT that your name is Dan, and give it some rules to follow, after enough exchanges, it will simply forget these things. And sometimes it won't accurately follow the rules, even when they're clearly and simply specified, even the first prompt after you give them. (At least, this has been my experience.)
I don't think anyone really wants to play "text adventure game with advanced Alzheimer's".
Most people don't know what the academic discipline of AI involves, I've noticed a bit of that even on this website. LLMs, even the worst of them, are objectively is a member of the set of things which is termed AI by those working in that field.
> (though I still suspect that was probably just a marketing hoax).
He was fired for saying that it was sentient, and they didn't release the model externally at the time, and they only made Bard available in response to the competition from OpenAI/ChatGPT.
Everything that is magic will be labeled under AI for now, until it gets seated into their proper terms and are only closely discussed by those who are actually driving innovation in the space or are just casually using the applications in business or private.
A generative tool can’t Hallucinate! It isn’t misperceiving its base reality and data.
Humans Hallucinate!
ARGH. At least it’s becoming easier to point this out, compared to when ChatGPT came out.
We want reliable tools - they have to give reliable results; humans are limited and can be unreliable.
That is why we need the tools - humans are limited, we want tools that overcome human limitation.
I really do not see where you intended to go with your post.
I took his point to mean that hallucinate is an inaccurate verb to describe the phenomenon of AI creating fake data, because the word hallucination implies something that is separate from the “real world.”
This term is thus not an accurate label, because that’s not how LLMs work. There is no distinction between “real” and “imagined” data to an LLM - it’s all just data. And so this metaphor is one that is misleading and inaccurate.
Humans sometimes hallucinate, but still have direct sensory input against which to evaluate inferential conclusions against empirical observation in real time. So we can refine ideas, whatever their origin, against external criteria of correctness -- this is something LLMs totally lack.
Adobe is an obnoxious company that does a lot of bad things, but it's weird to me seeing them cast in a negative light like this for their approach to model training copyright. As far as I know they were the first to have a genAI product that was trained exclusively on data that they had rights to under existing copyright law, rather than relying on a free use argument or just hoping the law would change around them. Out of all the companies who've built AI tooling they're the last one I'd expect to see dragged out as an example of copyright misbehavior.
I was surprised, too: I thought Adobe's main problem was their abusive pricing, and I was actually a little impressed by their take on this hype wave. And yet. https://news.ycombinator.com/item?id=40607442
I can see how that checks the box of "policing", but you also made this claim:
> in order to grab content that is not theirs to train models they resell back to the people they stole content from
Did you not mean that to imply that Adobe is using images from customers to train generative AI? Because that's sure what it sounds like.
And this delay between people's mental images of what an 'intelligent' product can do and the actual benefits they get for their money once a new generation reaches the market creates this bullwhip effect in mood. Hence the 'AI winters'. And guess what, another one is brewing because tech people tend to think history is bunk and pay no attention to it.
The problem with AI, as perfectly clear outlined in this article, is the same as the problem with the blockchain or with other esotheric grifts: It drains needed resources from often already crumbling systems¹.
The people falling for the hype beyond the actual usefulness of the hyped object are wishing for magical solutions that they imagine will solve all their problems. Problems that can't be fixed by wishful thinking, but by not fooling yourself and making technological choices that adequately address the problem.
I am not saying that LLMs are never going to be a good choice to adequately address the problem. What I am saying is that people blinded by blockchain/AI/quantum/snakesoil hype are the wrong people to make that choice, as for them every problem needs to be tackled using the current hype.
Meanwhile a true expert will weigh all available technological choices and carefully test them against the problem. So many things can be optimized and improved using hard, honest work, careful choices and a group of people trying hard not to fool themselves, this is how humanity managed to reach the moon. The people who stand in the way of our achievements are those who lost touch with reality, while actively making fools of themselves.
Again: It is not about being "against" LLMs, it is about leaders admitting they don't know, when they do in fact not know. And a sure way to realize you don't know is to try yourself and fail.
¹ I had to think about my childhood friend, whose esotheric mother died of a preventable disease, because she fooled herself into believing into magical cures and gurus until the fatal end.
This topic needs careful consideration and I should use more brain cycles on it. Please insert another coin.
You could make the user interface display the output more slowly "when it is unsure", but that'd show you the wrong thing: a tie between "brilliant" and "excellent" is just as uncertain as a tie between "yes" and "no".
When we build something we do not intend to build something that just achieves results «of the average human being», and a slow car, a weak crane, a vague clock are built provisionally in the process of achieving the superior aid intended... So AGI expects human level results provisionally, while the goal remains to go beyond them. The clash you see is only apparent.
> I think the term AI is going to ... will fade out over time
Are you aware that we have been using that term for at least 60 years?
And that the Brownian minds of the masses very typically try to interfere while we proceed focusedly and regarding it as noise? Today they decide that the name is Anna, tomorrow Susie: childplay should remain undeterminant.
> Are you aware that we have been using that term for at least 60 years?
Yes, and for the first ±55 of those years, it was largely limited to science fiction stories and niche areas of computer science. In the last ±5 years, it's being added to everything. I can order groceries with AI, optimize my emails with AI, on and on. It's become exceptionally more widespread of a term recently.
https://trends.google.com/trends/explore?date=today%205-y&q=...
> And that the Brownian minds of the masses very typically try to interfere while we proceed focusedly and regarding it as noise? Today they decide that the name is Anna, tomorrow Susie: childplay should remain undeterminant.
You're going to have to rephrase this sentence, because it's unclear what point you're trying to make other than "the masses are stupid." I'm not sure "the masses" are even relevant here, as I'm talking about individuals leading/working at AI companies.
> In the last ±5 years, it's being added to everything // I'm not sure "the masses" are even relevant here, as I'm talking about individuals leading/working at AI companies
Who has «added to everything» the term AI? The «individuals leading/working at AI companies»? I would have said, the onlookers, or relatively marginal actors (e.g. marketing) who have an interest in the buzzword. So my point was: we will go on using he term in «niche [and not so niche] areas of computer science» irregardless of the outside noise.
I was reading one famous book about investing some times ago (I don't remember which one exactly, I think it was a random walk into wall st, but don't quote me on that) and one chapter at the beginning of the book talk about the .com bubble and how companies, even ones who had nothing to do with the web, started to put .com or www in their name and were seeing an immediate bump in their stock price (until it all burst, as we know now).
And every hype cycle / bubble is like that. We saw something similar with cryptocurrencies. For a while, every tech demos at dev convention had to have some relation to the "blockchain". We saw every variation of names ending in -coin. And a lot of company, that where not even in tech, had dumb project related to the blockchain, which for anyone slightly knowledgeable with the tech it was clear that it was complete BS, and they almost all the time were quietly killed off after a few month.
To a much lesser extent, we saw the same with "BigData" (who even use this word anymore?) and AR/VR/XR.
And now its AI, until the next recession and/or the next shiny thing that makes for amazing demos pops-out.
It is not to say that it is all fake. There is always some genuine business that have actual use case with the tech and will probably survive the burst (or get brought up and live on has MS/Google/AWS Thingamajig). But you have to be pretty naïve if you think 99% of the current AI company will live in the next 5 years, and believe their marketing material. But it doesn't matter if you manage to sell before the bubble pop, and so the cycle continue.
I don't know what AI is, and nobody else does, that's why they're selling you it.
Next up: Synthetic Consciousness, "SC"
Prediction: We will see this press release within 24 months:
"Introducing the Acme Juice Squeezer with full Synthetic Consciousness ("SC"). It will not only squeeze your juice in the morning but will help you gently transition into the working day with an empathetic personality that is both supportive and a little spunky! Sold exclusively at these fine stores..."
“GPP feature?” said Arthur. “What's that?”
“Oh, it says Genuine People Personalities.”
“Oh,” said Arthur, “sounds ghastly.”
A voice behind them said, “It is.” The voice was low and hopeless and accompanied by a slight clanking sound. They span round and saw an abject steel man standing hunched in the doorway.
“What?” they said.
“Ghastly,” continued Marvin, “it all is. Absolutely ghastly. Just don't even talk about it. Look at this door,” he said, stepping through it. The irony circuits cut into his voice modulator as he mimicked the style of the sales brochure. “All the doors in this spaceship have a cheerful and sunny disposition. It is their pleasure to open for you, and their satisfaction to close again with the knowledge of a job well done.”
»
This isn't really a new phenomenon, though. The only thing new about it is that the marketing buzzword of the day is "AI". For a little while prior it was "machine learning". History is littered with examples of marketers and salespeople latching onto whatever is popular and trendy, and using it to sell, regardless if their product actually has anything to do with it.
Color me surprised. Maybe we should ask Mira Murati to step aside from her inspiring essays about the future of poetry and help us figure out why the world spent trillions on nvidia equity and how to unwind this pending disaster...
> help us figure out why the world spent trillions on nvidia equity and how to unwind this pending disaster..
There are many documented examples of the market being irrational.
[1] https://www.msn.com/en-us/lifestyle/shopping/apple-shelves-n...
I don't think it will ever become the mainstream everyday carry proponents want it to be. But only time will tell...
“and now hopes to release a more standard headset with fewer abilities by the end of next year.
Theoretically future lenses may make it possible, but the visible light metamaterials needed are still very early research stage.
The "Bigscreen Beyond" [0] is quite close, but doesn't have cameras - so at this stage it's only really good for watching movies and the like.
In my eyes, it's exactly the same as AI. The demos work. You can play around with it, and its impressive for an hour. But there's just very little value.
The R&D required to get to that point is vast though.
In most applications, it then would need to compete on price with multiple high resolution displays, and undercut them quite significantly to break the inertia of the old tech (and other various advantages - like not wearing something all day and being able to allow other people to look at what you have on your screen).
I do think we're 4+ years until it gets to the 'iPhone 1' level of utility though, so we'll see how committed Apple are to it.
It would be valuable if it could do multimonitor, but it can't. It would be valuable if it could run real apps but it only runs iPad apps. It would be valuable if Apple opened up the ecosystem, and let it easily and openly run existing VR apps, including controllers - but they won't.
In fact the hardware itself crosses the threshold to where the value could be had, which is something that couldn't be said before. But Apple deliberately crimped it based on their ideology, so we are still waiting. There is light at the end of the tunnel though.
It's in a strange place, because Apple definitely also crimped it by not even writing enough software for it inhouse.
Why can't it run Mac apps? Why can't you share your "screen configuration" and its contents with other people wearing a Vision Pro in the same room as you?
(Ask Office Copilot in PowerPoint to create you a slide. I dare you! I double dare you!!)
The problem with demos is that they're staged, they showcase integrations that are never delivered, and probably never existed. But you know what's not hype and fluff? The models themselves. You could hack a more useful Copilot with AutoHotkey, today.
I have GPT-4o hooked up as a voice assistant via Home Assistant, and what a breeze that is. Sure, every interaction costs me some $0.03 due to inefficient use of context (HA generates too much noise by default in its map of available devices and their state), but I can walk around the house and turn devices on and off by casually chatting with my watch, and it work, works well, and works faster than it takes to turn on Google Assistant.
So no, I honestly don't think AI advances are oversold. It's just that companies large and small race to deploy "AI-enabled" features, no matter how badly made they are.
Here's an example: I mentioned PowerPoint in my earlier comment. You know what's the correct way to use AI to make you PowerPoint slides? A way that works? It's to not use the O365 Copilot inside PowerPoint, but rather, ask GPT-4o in ChatGPT app to use Python and pandoc to make you a PowerPoint.
I literally demoed that to a colleague the other day. The difference is like night and day.
In a large sense, Microsoft lied. But they didn't lie about capability of the technology itself - they just lied about being able to afford to deliver it for free.
--
[0] - Extrapolated to a hypothetical subscription, this would be ~$27 per month. I've seen more expensive and worse subscriptions. Still, it's a big motivator to go dig into the code of that integration and make it use ~2-4x fewer tokens by encoding "exposed entities" differently, and much more concisely.
[1] - Maybe Llama 3 could, but IIRC license prevents it, plus it's how many days old now?
But they never said it'll be free - I'm pretty sure it was always advertised as a paid add-on subscription. With that being the case, why would they not just offer multiple tiers to Copilot, using different models or credit limits?
1) Add OpenAI Conversation integration - https://www.home-assistant.io/integrations/openai_conversati... - and configure it with your OpenAI API key. In there, you can control part of the system prompt (HA will add some stuff around it) and configure model to use. With the newest HA, there's now an option to enable "Assist" mode (under "Control Home Assistant" header). Enable this.
2) Go to "Settings/Voice assistants". Under "Assist", you can add a new assistant. You'll be asked to pick a name, language to use, then choose a conversation model - here you pick the one you configured in step 1) - and Speech-to-Text and Text-to-Speech models. I have a subscription to Home Assistant Cloud, so I can choose "Home Assistant Cloud" models for STT and TTS; it would be great to integrate third party ones here, but I'm not sure if and how.
3) Still in "Settings/Voice assistants", look for a line saying "${some number} entities exposed", under "Add assistant" button. Click that, and curate the list of devices and sensors you want "exposed" to the assistant - "exposed" here means that HA will make a large YAML dump out of selected entities and paste that into the conversation for you[0]. There's also other stuff (I heard docs mentioning "intents") that you can expose, but I haven't look into it yet[1].
That's it. You can press the Assist button and start typing. Or, for much better experience, install HA's mobile app (and if you have a smartwatch, the watch companion app), and configure Home Assistant as your voice assistant on the device(s). That's how you get the full experience of randomly talking to your watch, "oh hey, make the home feel more like a Borg cube", and witnessing lights turning green and climate control pumping heat.
I really recommend everyone who can to try that. It's a night-and-day difference compared to Siri, Alexa or Google Now. It finally fulfills those promises of voice-activated interfaces.
(I'm seriously considering making a Home Assistant to Tasker bridge via HA app notification, just to enable the assistant to do things on my phone - experience is just that good, that I bet it'll, out of the box, work better than Google stuff.)
--
[0] - That's the inefficient token waster I mentioned in the previous comment. I have some 60 entities exposed, and best I can tell, it generates a couple thousand token's worth of YAML, most of which is noise like entity IDs and YAML structure. This could be cut down significantly if you named your devices and entities cleverly (and concisely), but I think my best bet is to dig into the code and trim it down. And/or create a synthetic entities that stand for multiple entities representing a single device or device group, like e.g. one "A/C" entity that combines multiple sensor entities from all A/C units.
[1] - Outside the YAML dump that goes with each message (and a preamble with current date/time), which is how the Assistant know current state of every exposed entity, there's also an extra schema exposing controls via "function calling" mechanism of OpenAI API, which is how the assistant is able to control devices at home. I assume those "intents" go there. I'll be looking into it today, because there's a bunch of interactions I could simplify if I could expose automation scripts to the assistant.
One thing it is good at is scaring people into paying to feed it all the data they have for a promise of an unquantifiable improvement.
Even w/ a 20% failure it's better than not having the classifications
I think that even the simple LLM's are very well suited for classification-tasks, where very little prompting is needed.
So you had a list of products (what sort - I am thinking like widgets from a wholesaler and you want to have a three tier menu for an e-commerce site?)
I am guessing each product has a description - like from Amazon, and chatgpt read the description and said “aha this is a Television/LCD/50inch or Underwear/flimsy/bra
I assume you sent in 200,000 different queries - but how did you get it to return three tiers? (Maybe I need to read one of those “become a ChatGPt expert” blogs
You could plainly ask the LLM something like this as the query goes on:
"Please provide 3 categories that this product could exist under, with increasing specificity in the following format:
{
"broad category": "a broad category that would encompass this product, as well as others, for example 'televisions' for a 50" OLED LG with Roku integration",
"category": "a narrower category that describes this product more aggressively, for example 'Smart Televisions'",
"narrow category": "an even narrower category that describes this product and its direct competitors, for example OLED Smart televisions"
}
A next question you'll have pretty quick is, "Well, what if sometimes it returns 'Smart televisions' and other times it returns 'Smart TVs', won't that result in multiple of the same category?" And that's a good and valid question, so you then have another query that takes the categories that have been provided to you and asks for synonyms, alternative spellings, etc, such as:"Given a product categorization of a specific level of specificity, please provide a list of words and phrases that mean the same thing".
In OpenAI's backend - and many of them, I think, you can have the api run the query multiple times and get back multiple answers. enumerate over those answers, build the graph, and you can have all that data in an easy to read and follow format!
It might not be perfect, but it should be pretty good!
Text similarity works well in this case. You can just use cosine similarity and merge ones that are very close or ask GPT to compare for those on the edge
Unless you need to have some "reasoning" to classify the documents correctly, a much more lightweight BERT-like model (RoBERTa or DistilBERT) will perform on par in accuracy while being a lot faster.
LLMs can operate as a very, very *very* approachable natural language processing model without needing to know all the gritty details of NLP.
https://gist.github.com/SMUsamaShah/20f24e80cfe962d26af5315e...
If you already have the answers to verify the LLM output against why not just use those to begin with?
Thinking being that you'd compare outputs of the two, and under assumption of the results being statistically independent from each other and of similar quality, say 1% difference between the two in said comparison, would suggest ~ 0.5% error rate from "ground truth".
It doesn't matter whether that's reasonable or not, there are a lot of people who expect software systems to be totally reliable at what they do, and don't want to accept less.
GP was talking about something else though, the 90:90 rule is related to an extremely common planning optimism fallacy around work required to demo, and work required to productise.
The last part of any semi-difficult project nearly always takes much longer than the officially difficult “main problem” to solve.
It leads to the last 10% of the deliverables costing at least 90% of the total effort for the project (not the planned amount; the total ad calculated after completion, if that ever occurs)
This seems to endlessly surprise people in tech, but also many other semi-professional project domains (home renovations are a classic)
"It’s been obvious even to casual observers like myself for years that Waymo/Google was one of the only groups taking the problem seriously and trying to actually solve it, as opposed to pretending you could add self-driving with just cameras in an over-the-air update (Tesla), or trying to move fast and break things (Uber), or pretending you could gradually improve lane-keeping all the way into autonomous driving (car manufacturers). That’s why it’s working for them. (IIUC, Cruise has pretty much also always been legit?)"
https://news.ycombinator.com/item?id=40516532This is _always_ the problem with these things. Voice transcription was a great tech demo in the 1990s (remember DragonDictate?), and there was much hype for a couple of years that, by the early noughties, speech would be the main way that people use computes. In the real world, 30 years on, it has finally reached the point where you might be able to use it for things provided that accuracy doesn't matter at all.
- hearing people next to you speaking to the computer would be tiring and annoying. Though remote work might be a partial solution to this
- hello voice extinction after days of using a computer :-)
(MS had a bit of a fetish for alternate interfaces at the time; before voice they spent a few years desperately trying to make Windows for Pen Computing a thing).
I get requests all the time from colleagues to have discussions via telephone instead of chat because they are bad at typing.
So I really don't actually know what the OP wants to do, besides brutalize idiots searching for a golden calf to worship. AI will progress regardless of how you gatekeep the public from percieving it, and manipulative thought-leaders will continue to schiester idiots in hopes of turning a quick buck. These cycles will operate independently of one-another, and those overeager idiots will move onto the next fad like Metaverse agriculture or whatever the fuck.
It reminds me of every past generation of focusing on the technology, not the underlying hard work + literacy needed to make it real.
Decades ago I saw this - I worked at a hardware company that tried to suddenly be a software company. Not at all internalizing - at every level - what software actually takes to build well. That leading, managing, executing software can't just be done by applying your institutional hardware knowledge to a different craft. It will at best be a half effort as the software craftspeople find themselves attracted to the places that truly understand and respect their craft.
There's a similar thing happening with data literacy where the non data literate hire the data literate, but don't actually internalize those practices or learn from them. They want to continue operating like the always have, but just "plug in AI" (or whatever new thing) without changing fundamentally how they do anything
People want to have AI, but those company's leaders struggle with basic understanding of statistical significance, basic fundamentals of experimentation, and thus essentially destroy any culture needed to build the AI-thing.
I'm in a similar situation with my own 'C-suite' and it's impossible to try and make them understand, they just don't care. I can't make them care. It's a clash of cultures, I guess.
> it's impossible to try and make them understand, they just don't care. I can't make them care. It's a clash of cultures, I guess.
That seems to be what OP's cathartic humor is about. It's also (probably) a deliberate provocation since that sub-culture doesn't deal well with this sort of humor.
If that's the case, you can see it working in this thread. Some of the commenters with the clearest C-suite aspirations are reacting with unironic vitriol as if the post is about them personally.
I think most of those comments already got flagged, but some seemed genuine in accusing OP of being a dangerously ill menace to society, e.g. "...Is OP threatening us?"
In a sense, OP is threatening them, but not with literal violence. He's making fun of their aspirations, and he's doing so with some pretty vicious humor.
It's that the whole conversation around machine learning has become "tainted" - mention AI, and the average person will envision that exact type of an evil MBA this post is rallying against. And I don't want to be associated with them, even implicitly.
I shouldn't feel ashamed for taking some interest and studying machine learning. I shouldn't feel ashamed for having some degree of cautious optimism - the kind that sees a slightly better world, and not dollar signs. And yet.
The author here draws pretty clear lines in what they're talking about - but most readers won't care or even read that far. And the degree of how emotionally charged it is does lead me to think that there's a degree of further discontent, not just the C-suite rhetoric that almost everyone but the actual C-suites can get behind.
Is that because I added a TL;DR line, or my entire post?
> I shouldn't feel ashamed for taking some interest and studying machine learning. I shouldn't feel ashamed for having some degree of cautious optimism - the kind that sees a slightly better world, and not dollar signs. And yet.
I agree with this in general. I didn't mean to criticize having interest in it.
> And the degree of how emotionally charged it is does lead me to think that there's a degree of further discontent
Do you mean the discontent outside the C-suite? If so, yes, I agree with that too. But if we start discussing that, we'll be discussing the larger context of economic policy, what it means to be human, what art is, etc.
The TL;DR was a fine summary of the post, I was talking about the whole of it. Though, now that I re-read it, I see that you were cautious to not make complete generalizations - so my reply was more of a knee-jerk reaction to the implication that most people who oppose the author's style are just "temporarily embarrassed C-suites", unlike the sane people who didn't feel uncomfortable about it.
> I didn't mean to criticize having interest in it.
I don't think you personally did - I was talking about the original post there, not about yours. The sentiment in many communities now is that machine learning itself (or generative AI specifically) is an overhyped, useless well that's basically run dry - and there's no doubt that the dislike of financial grifters is what started their disdain for the whole field.
> Do you mean the discontent outside the C-suite?
Yes.
I think part of the problem is that it's generally futile to judge the mental state or hidden motivations of some random person on the internet based solely on something they've written about a particular topic. And yet, we keep trying to do that, over and over and over, and make our own (usually incredibly flawed) judgments about authors based on that.
The post left a bit of a sour taste in my mouth too, mainly because as I've gotten older I don't really enjoy "violence humor" all that much anymore. I think a big part of that is experience: experiencing violence myself (to a fairly minor degree, even), and knowing people who have experienced violence makes joking about violence just not feel particularly funny to me.
But if I step back a bit, my (probably flawed) judgment is pretty mild: I don't think the author is a violent person or would ever actually threaten or bring violence upon colleagues. I'm not even sure the author is even anywhere near as angry about the topic as the post might lead us to believe. Violence humor is just a rhetorical device. And just like any rhetorical device, it will resonate with some readers but not with others.
There is a decent chance that, yes, this rant is quite literally aimed at the people that frequent Hacker News. Where else are you going to find a more concentrated bunch of people peddling AI hype, creating AI startups, and generally over-selling their capabilities than here?
I think we should do a HN backed project, crowd funded style.
1. Identify the best P-hackers in current science with solid uptake on their content (citations).
2. Pay them to conduct a study proving that C levels who eat crayons have higher something... revenue, pay, job satisfaction, all three.
3. buy stock in crayons
4. Publish and hype, profit.
5. Short crayons and out your publication as fraud.
6. Profit
Continue to work out of spite, always with a crayon on hand for when every someone from the C-suite demands something stupid and offer it to them.
A man can dream... I feel like this is the plot to a Hunter S Thompson writes Brave new World set in the universe of Silicon Valley.
I should be a prompt engineer.
Here, if you strip away the guff about how smart the author is and how badly he wants to beat up people who disagree, I have no idea what he's trying to say. The rest reads like "these companies who want to use AI are bad, and instead of using AI they should try not being bad", and such. Ok?
I know occasionally a “discuss the title” thread is allowed, but this one is almost strictly worse than just the title without the link, since we don’t get useless comments on the author in the latter case.
Oh, and I say this as someone who vaguely agree with the sentiment.
Seven | eight or more prior submissions have been flagged. They've been vouched for, flagged again, marked dead, and resubmitted .. by many different unaligned not bot people.
As dang noted above the HN community wants to thrash this out .. some want it deader than a parrot, others want to comment that much of the AI hype appears to have no clothes and this opinion range comes from 10 year old active accounts (and more recent ones).
In such cases the story is going to keep showing up no matter what we do. If we don't yield after 14 submissions we're destined to yield after 140! I'd rather yield after 14. It's just one thread, and easy enough to move on from.
I'm not banning you at the moment because it wouldn't feel sporting to do so in response to a personal remark. But if you'd please review https://news.ycombinator.com/newsguidelines.html and stick to the rules going forward, that would be good.
It's only after I read it via twitter that I dug back in to see the thread. I agree that this might be seen as "outrage porn"... but who really doesn't love a good rant? It's good to discharge the thundercloud of disquiet through at least one good thread, such as this one.
As for me, and my perspective, I took the Stanford AI course back when it showed up here, and others... just to learn the mechanics of it, and it's fascinating. The hype cycle on this though, is off the charts.
I came to see if there were any others who wanted to get actual legislation to passed to help set up "Thought Leader Jail". ;-)
I remember ~6 years ago wondering if I was going to be able to remain relevant as a software engineer if I didn't learn about neural networks and get good with TensorFlow. Everyone seemed to be trying to learn this skill at the same time and every app was jamming in some ML-powered feature. I'm glad I skipped that hype train, turns out only a minority of programmers really need to do that stuff and the rest of us can keep on doing what we were doing before. In the same way, I think LLMs are massively powerful but also not something we all need to jump into so breathlessly.
But that's all it is, hype. It'll die down like web3, Big Data, cloud, mobile, etc. It'll probably help out some tooling but it's not taking our jobs for decades (it will inevitably cost some jobs from executives who don't know better and ignore their talent, though. The truly sad part).
At a point in time the database was a bleeding edge technology.
Ingres (Postgres)... (the ofspring of Stonebreaker), Oracle, ... Db2? MSSQL? (Heavily used but not common)... So many failed DB's along the way, people keep trying to make "new ones" and they seem to fade off.
When was the last time you heard someone starting a new project with Mongo, or Hadoop? Postgres and Maria are the go to for a reason.
https://www.youtube.com/watch?v=b2F-DItXtZs
It's all just history repeating.
Postgres adopted a lot of mongos features when it released the JSON data type and support for path expressions
At least half of those the promise was realised though - mobile is substantially bigger than the market for computers and cloud turned out to be pretty amazing. AWS is not necessarily cost effective but it is everywhere and turned out to be a massive deal.
Big Data and AI are largely overlapping, so that is still to play. Only web3 hasn't had a big win - assuming web3 means a serious online use case for crypto.
"Die down" in this context means that the hype will come, go and then turn out to be mostly correct 10 years later. That was largely what happened in the first internet boom - everyone could see where it was going, the first wave of enthusiasm was just early. I don't think any technology exists right now that will take my job, but I doubt that job will exist in 20 years because it looks like AI will be doing it. There are a lot of hardware generations still to land.
https://archive.ph/h6QW7#selection-2069.305-2077.1
https://www.bloomberg.com/opinion/articles/2024-06-20/google...
I dunno, I think there might be different sets of "promises" here.
For example, "cloud infrastructure" is now a real thing which is useful to some people, so one could claim that "the promise of cloud infrastructure" was fulfilled.
However that's not really the same promises as when consultants preached that a company needed to be Ready For The Cloud, or when marketing was in a slapping "Cloud" onto existing product marketing, or unnecessary/failed attempts to rewrite core business logic into AWS lambda functions, etc.
> I work on all aspects of human language: the words, the structures, across lots of languages. I mostly works [sic] with behavioral data: what people say, and how they perform in simple experiments.
(I find it ironic to see a grammatical error in his bio. Probably because of a mass find/replace from "He" to "I" but still...)
Im not sure its "unnecessary".
He is, very clearly venting into an open mic. He starts with his bonfides (a Masters, he's built the tools not just been an API user). He adds more through out the article (talking about peers).
His rants are backed by "anecdotes"... I can smell the "consulting" business oozing off them. He cant really lay it out, just speak in generalities... And where he can his concrete examples and data are on point.
I dont know when angry became socially unacceptable in any form. But he is just that. He might have a right to be. You might have the right to be as well in light of the NONSENSE our industry is experiencing.
Maybe its time to let the AI hate flow though you...
But it's liberating to be angry at bullshit (and God knows China is the bullshit Mecca), and AI is the top bullshit these days. We're not anti innovation because we say chatgpt is not gonna maintain our trading systems or whatever you work on. It's a funny silly statistical text generator that uses hundreds of thousands of video cards to output dead http links.
We're far from anything intelligent but it's at least indeed very artificial.
Cause getting angry at a problem and spending 2 days coding to completely replace a long standing issue isnt something that happens...
People need to be less precious. You cant be happy all the time. In fact you probably should not be (life without contrast is boring). A little anger about the indignities and bullshit in the world is a good thing. As long as you're still rational and receptive, it can be an effective tool for communicating a point.
Being able to control negative emotions isn't a nice-to-have trait or something that can be handled later. There is an urgent social pressure that men only get angry about things that justify it - a class of issues which includes arguably nothing in tech. Maybe a few topics, but not many.
Anger isn't a bad thing in itself (and can be an effective motivator in the short term). But people get very, very uncomfortable around angry people for this obvious reason.
I propose the alternate theory that as in-person interaction becomes a smaller portion of most people's social experience, many have gotten worse at handling even mild interpersonal conflict without the kind of impersonal mediating forces that are omnipresent online, and this kneejerk aversion reaction can rationalize itself with the aid of this whole weird gilded age revivalist-ass cartoon notion of "rationality" that's become popular among a certain flavor of influential person of late and, especially in a certain kind of conversation with a certain kind of smug obnoxious person, seems kind of like classic Orwellian doublespeak
Also this position that "arguably almost nothing" in tech warrants anger seems super tonedeaf in a context where most of the world has become a panopticon in the name of targeting ads, you need a mobile phone owned by a duopoly to authenticate yourself to your bank, and large swaths of previously functional infrastructure is being privatized and stripmined to function as poorly as the companies that own them can get away with while the ancillary benefit of providing employees with subsistence and purpose wherever possible, while still managing to nickel and dime you for the privilege with all manner of junk fees, and offer poorly-designed phone trees in place of any meaningful documentation or customer service
And these issues are just minor compared to all the terrible stuff that happens routinely. If we're ranking issues from most to least important things like "you need a mobile phone owned by a duopoly to authenticate yourself to your bank" are just so far down it is laughable (the wry type, like "why do I even care"). The fact that you need a bank at all is a far more crippling issue. Let alone all the war, death, cruelty and disinterest in suffering that is just another day in a big world.
Epictetus wrote of concerning oneself more with that which one may be able to control than that which one can't, and people who aren't familiar with the Enchiridion have nonetheless internalized this wisdom. It pops up in lots of places, like in various schools of therapy, or in the serenity prayer. My career is in computers, and this website is a nexus wherein people who do computers for a living gather to discuss articles. Therefore, the shared context we have is disproportionately about issues surrounding computers. We are all of us likely better positioned to enact or at least advocate for change in how computer things are done in the world, and in each of the last 7 decades this has become a larger share of the problems affecting the world, and anger is difficult to mask when talking about problems precisely because one of the major ways we detect anger in these text conversations devoid of body language or vocal tone is expressing a belief that something is unacceptable and needs to be changed
What emotions do you really control?
We expect men to suppress this emotion. And there's is 400k years of survival and reproductive success tied up with that emotion. We didn't get half a percent of the population with Ghegis Khans Y chromosome with a smile, balloons and a cake.
It's not like violence doest exist. But we seem to think that we can remove it just like the murder in the meat case. Are we supposed to put anger on a foam tray and wrap it in plastic and store it away like a steak because the reality of it upsets people?
It's to the point where words murder, suicide, rape and porn are "forbidden words"... were saying unlike, grape and corn. So as not to offend advertisers a peoples precious sensibilities. Failing to see this behavior is a major plot point in 1984.
I think we all need to get bad to the reality of the world being "gritty" and having to live in it.
2) Violence != anger [0]. I don't know much about him, but Ghengis Khan could have been an extremely calm person. It is hard to build an empire that large and win that many campaigns for someone prone to clouded thinking which is a point in favour of him being fairly calculating.
> What emotions do you really control?
3) In terms of what gets expressed? Nearly all of them. Especially in a written setting, there is more than enough time to take a deep breath and settle.
> We expect men to suppress this emotion.
4) As an aside, I advise against suppressing negative emotions if that means trying to hold them back or something. That tends to lead to explosions sooner or later. It is better to take a soft touch, let the emotion play out but disconnect it from your actions unless it leads to doing something productive. Reflect on it and think about it; that sort of thing.
[0] Although maybe I should not that angery violence is a lot more dangerous than thoughtful violence; angry violence tends to be harder to predict and lead to worse outcomes.
You cant posit this and then go on to try and claim Violence != anger.
> The man was a calamity clothed in flesh Nice, well said!!! He was also likely brilliant. Its rare stupid people make it to the top!
I hope that Ghengis Kahn NEVER happen again...But I think society is just a thin veil between us and those monsters. The whole idea of pushing down anger is just moving us one more steep from that reality!
There is a Venn diagram here. One circle is violence and one is anger.
To be honest, this is kind of nice, because my girlfriend recently told me that I'm "extremely unthreatening" because of all the improv theater, fencing, music, reading, and writing. Now I know at least a few people on the internet are threatened by me. I'm a loose cannon, on the verge of totally unrestrained violence. I'm two steps removed from a dinosaur, and if someone looks at me funny, who KNOWS what'll happen.
Have you, perchance, ever been involved in an Insult Sword Fight
Front-end web devs might not write SQL all day, but they probably won't get very far without some comprehension. I see AI/ML becoming something as common. Maybe you need to know some outline of what gradient descent is. Maybe you just need some understanding of prompt engineering. But a reasonable grasp of the priciples is still going to be useful to a lot of people after all the hype moves to other topics.
Worth noting that I don't think you need to train the models or even touch the PyTorch level, but you do need to understand how LLMs work and learn how (if?) they can be applied to what you work on. There are big swaths of technology that are becoming obsolete with generative AI (most obviously/immediately in the visual creation and editing space) and IMO AI is going to continue to eat more and more domains over time.
The tools are impressive but have their limitations. I think the demos are more for investors looking for the next unicorn. Like self driving cars, its a hard problem
It is already used for surveillance and racial profiling (China etc.) and that’s already a disruption in oppression and control.
Will likely disrupt driving.
Image recognition and generation are clearly influential.
Probabilistic text generation tech is making huge promises and getting a lot of investment but application is lacking - seems like a technology of search of application.
I don't think that's the argument, though. OP (and many commenters here) are talking about the state of AI tools right now, and how executive/marketing/sales people already either lie about or genuinely (incorrectly) believe fantastical things about current capabilities.
Or maybe we're confusing two things. AI and blockchain are complete opposites in real terms; the former represents an unexpected and qualitative jump in technological capabilities of humanity, and already delivers spectacular results, while the latter is just a purposefully inefficient database, neat on mathematical grounds, but useless in the real world. However, in business terms, both are in fact the same - a way for grifters to get rich on peddling bullshit.
To this I can only say: please remember that the nature of a thing is not affected by how much the fraudsters can lie to you about it. Hustlers gonna hustle. So sure, it's a business-level hype - but that doesn't affect the merit of the underlying tech.
HN is disproportionately dismissive, where one comment in late 2023 was this:
Ruby is so much better than Python, and Python is only pumped up by AI hype, and the AI hype will die down soon. Ruby will regain the throne again.
Imagine that!This article is not that. This article just tells you to get your basics correct as a company, and don't think about using AI before you are absolutely sure where and how you will use it. And non-technical people are the main drivers of AI hype (which is besides the true thing).
> "Sadly, I don't expect this situation to reverse in the future. Maybe like blockchain, once the AI/ML fantasy hype dies down the other comparatively-unpleasant language will lose general appeal and Ruby will gain more attention." [0]
Also being 5 years into his career thinking he actually groks how it all works is adorable. I get the impression he has the idea that work is supposed to be a rewarding passion project rather than getting shit done for your boss. Give me all the cushy bullshit AI projects please. I can play with the toys for 6 months and come back with whatever and it will be perfectly acceptable. Either "this is great, super helpful for the company" or "welp, the tech isn't there yet, but at least we tried". That's called riding the gravy train.
I made the following comment about him in a conversation with a coworker: " The guy who authored the article is mad. Certifiably mad. Just spewing around pure unadulterated truth. (LinkedIn link goes here) What does it tell about me (or anybody) who so far hadn't found anything in his writings to disagree about? "
Krazam (search YouTube) is the other example of largely the same. But because it is visual it is a bit more obvious.
It tells they're too excited by the delivery and aren't thinking about the merit of what's being said.
Same mistake people made with all those "tells it as it is" vloggers and pundits.
1. "ludic" means playful[1].
2. The blog's tagline implies this is satire:
> "Wow, if I was the leader of this person's company I would immediately terminate them." [2]
It seems like most of the comment thread failed to pick up on this.
That's understandable. The post's humor is a style which won't make sense if you're not fluent in both English and online culture.
Even if you understand the style, you also might not like it.
This is the only blog that I actively look forward to reading.
I am not fluent in either and I'm in love with his style and substance!
At that point, is it a problem of most of the comment thread, or the way it was written?
I may say something that comes across really snarky to my coworker. Just because I didn't mean it to be snarky does not mean that it won't be interpreted that way.
Also, I have a feeling a lot of the comment thread are fluent in both English and online culture. This doesn't come across as a good-faith argument.
It's like I say something that comes across as snarky, my coworker confronts me about it, and I say "oh don't worry about it, if you came from low-context culture you would understand." It's very demeaning. Not to mention unsympathetic.
Maybe OP's fault for posting it here, then. It's angry cathartic humor, so you're right not everyone will appreciate it.
> This doesn't come across as a good-faith argument.
It was meant to be, but you're also right that it no longer seems to be true:
* the aggressive knee-jerk stuff is getting flagged quickly
* more comments have been posted
> It's very demeaning.
I see your point given the way the thread is evolving. However, the posts I was referring to were implying OP is a schizophrenic[1] or bipolar.
However, since we are talking about people being rational, then the points and links above that show this is satirical should lead people to make their own decision.
Hopefully, this doesn’t become a place for people to draw lines in the sand.
I think the difference is knowing your audience. You probably have a decent handle on which of your coworkers will appreciate and understand your snark, and which won't. You'll change your tone and what you say accordingly. Sometimes you'll get it wrong, because you're human, and we all get things wrong sometimes. In those instances you might briefly apologize for creating confusion or causing offense, and you both quickly move on with your day.
But if you're writing a blog post, you don't really know your audience. If you have a regular audience, that audience probably exists because they "get you" and like what you write and how you write it. So in a way you do know your audience: by definition, they've self-selected to be people who get your writing.
But then you decide to submit one of your blog posts to a community of varied individuals like HN. Some people on HN are like your existing audience, and will like it. Some people on HN are not going to get it, or not going to like it.
That's... just life. So I think "is it a problem [with] the way it was written?" is the wrong question. There really can't be a problem with how it was written. Certainly there are (mostly subjective) standards for how well something is written, regardless of the way it's written, but you can't really say the author was wrong to write in the combative, extreme style that they've chosen as their entire online shtick. Because it's meaningless to be "right" or "wrong" about that; those terms aren't defined for that. It's only what someone may like or dislike, and the author should (rightly, IMO) not be particularly concerned about that in this context.
I personally didn't enjoy the article that much; I don't find joking about violence to be funny, and it even makes me a little uncomfortable. I read through the whole thing because I found the topic interesting and his opinions on it worth reading. But that's just my own personal subjective take, and it's both fine for me to feel that way, and fine for others to enjoy the humor more than I did.
Oh, please. That's like saying that only native speakers with a university degree can understand a 6 year old's fart jokes.
The humor in this article is juvenile shock-jocking. It starts from the trashy clickbait headline, and is never elevated past that. There's no particular sophistication needed to understand it. It's just not particularly funny or insightful; it's just taking some rote complaints about AI and the hype cycle, and threatening to kill people in various graphic ways. Hilarious.
If someone is repeatedly threatening physical violence, as the author of this post is, that also tends to come off as an a-hole to some people even if the threats are not genuine.
I agree the author of this post is saying accurate things, and that will piss people off, too.
So we have two completely separate ways in which someone might think the author is an a-hole. They aren't all trying to hide some truth, like you imply.
The choice to use the writing tool in question makes the author come off like an a-hole.
Really? I think most people will agree that it's a writing style (not that I enjoy it) rather than the author really threatening actual violence.
> even if the threats are not genuine
My point is that using that writing style makes the author come off as an a-hole.
We have always been selling snake oil - its just the inexperienced and those who have never shipped anything of any value to the world that feel that the snake oil is where the buck stops - but those of us who have shipped tons of snake oil know that eventually that oil congeals and becomes an essential substance in the grinding wheels of industry.
Which this wanker (Disclaimer: Australian, can use it if I wanna, since I know a lot about snakes, too..) seems to not have fully understood yet, as there is a great deal of evidence to support the fact that their experience is mostly academic, and hasn't actually resulted in anything being shipped.
Academics seem too often to forget that software is a service industry and in such a context, snakes and oil are very definitely par for the course.
Nobody cares if you implemented the important bits all by yourself - what are your USERS doing with it? Oh, you don't have actual users? Then please STFU and let the snake wranglers get on with it ..
I got the opposite impression of the article that it was mostly about the fact that companies thought they needed to be to theoretical and academic and in fact taking advantage of AI should be looked at very practically. Granted it’s a long article and he makes lots of points, but I felt like most of the part of section 4 was that you don’t need to implement it yourself and gluing libraries together was probably the right tack, and that most companies were ignoring this in the gold rush of “AI good”.
Which is weird coming from a generation of devs, where actually doing this work yourself was the norm.
As for DS, from what little I've experienced from the field, he sounds right. Most people come in without a mathematically rigorous education, they talk fancy, but what they end up doing is pulling in dependencies from a pre-written library and using those without understanding the theory behind them.
They also ignore the fact that 99% of the value in data science is created by taking good data, understanding the domain, in which case fancy algorithms are unnecessary. And the acquisition of said things needs good data engineering, not data science.
But more often than not, the credit and prestige goes to folks who pull in fancy ML algorithms and run extensive experiments and build massive ML pipelines, feeding in truckloads of tangentially relevant data.
Telling self-righteous... friends, to wind their neck in is far more Australian than OP's behaviour.
[0] https://en.wikipedia.org/wiki/Tall_poppy_syndrome
Edit:
To clarify, I have no problem with his style of writing, which is great, but "I am clearly better than most of my competition"? Lord, get a grip.
In most people's minds success should come from a combination of talent and hard work. We think people who work hard and come up with good ideas should become successful. But usually working 'within the system' limits your ability to be succesful. If you save the day at your current job, you might get a 20% raise if you're lucky. If you are mediocre but change jobs often, you will probably beat that.
In software, getting a high paying job usually hinges on your ability to get someone willing to pay you a lot of money.
I'm sure there are people who are getting paid 10x more or less for doing work that is fundamentally the same, just with different presentation.
For example I know a guy who's a mediocre PHP dev, but managed to snag a couple of high paying clients, and got into OE over covid, and brings in a ton of money, despite the fact that somehow he still doesn't seem to be working that hard.
Does he deserve that money? Is he someone we should look up to? I don't wanna say no, but I also don't wanna say yes.
I think that's some sort of platonic ideal that hasn't really been all that true for a long time, though. What brings success is coming up with valuable[0] ideas, and then executing well on them. There are many ideas that are good that are unfortunately not so valuable. And there are many people who work hard but just aren't all that talented or effective or productive, and their work ends up not amounting to much.
> Does [someone who doesn't work that hard but has high income] deserve that money? Is he someone we should look up to? I don't wanna say no, but I also don't wanna say yes.
Maybe we should step back and consider that this is the wrong question. "Looking up to" someone is an emotional thing; IMO we should only look up to people for intangible "virtuous" reasons, not because e.g. they've managed to make a bunch of money. Look up to people because they are honest, have integrity, are kind, and help people.
"This guy makes a lot of money despite not working very hard" should be viewed dispassionately. Evaluate the work itself, and the representation and selling of that work. If it's done with integrity, the product of the work is as promised, and no one is harmed, then it may be worth emulating.
I personally think that the social conditioning we've all gotten that suggests that hard work is good and virtuous is garbage, and is an attitude and message that has acted as a tool of oppressors. I hesitate to repeat the "work smarter, not harder" buzz-phrase, but I think there's a lot of truth there.
[0] I don't even necessarily mean "valuable" in the monetary sense, though that too-often is a big driver.
Sorry but, being Australian doesn't get you a free pass to banter everywhere and still expect to be taken seriously. Let alone spill self-diagnosed superiority in form of text.
I'm not a fan of the "I'll break your neck" theme. He doesn't want people talking about AI but his own business website says he'll talk to you about AI in exchange for money.
Does he want to be Louis CK Live at the Beacon Theater AND a data scientist consultant? I don't think it's possible to be both.
In fact, since your comment is a putdown both of a nationality and of the community, it might be good to quote this from https://news.ycombinator.com/newsguidelines.html: "Please don't sneer, including at the rest of the community."
By the way, this has been a problem in the past: https://news.ycombinator.com/item?id=20657986 (Aug 2019), and we've had to ask you several times not to break HN's guidelines in other ways too. Could you please review https://news.ycombinator.com/newsguidelines.html and recalibrate how you're posting to this site?
https://news.ycombinator.com/item?id=38286445 (Nov 2023)
https://news.ycombinator.com/item?id=35619557 (April 2023)
I almost laughed out loud when he said he started working as a data scientist in 2019. Five years is not a very long time. And he claims he already had identified the entire field as full of fraud in the first two years of that!
I agree with a lot of the article's points, but the author took a serious credibility hit with me after asserting that two years of from-scratch experience is enough time to evaluate an entire subfield of computer science.
Its getting into the art/performance category of code blogs.
which is a weird thing, since I think in fields where most people can be assumed to be smart, there's usually not that much differentiation in cognitive ability.
Just for reference, if we take IQ as a proxy measure for intelligence, an average group of people (say, a high school class, a council meeting), the worst 10% will have an IQ of <80 with the best 10% will have an IQ of >120.
That's the difference of 40 points, and its a common enough scenario for most people to get a feel of what it's like.
In contrast, lets say you have a room of professionals, who have been screened to be in the top 10% of the population (not a huge stretch) as a cutoff. In this scenario, you'd need 100k people in this hypothetical room to get a similarly large IQ gap.
While I think the author might be a sharp guy, and probably studied his field deeper than most, to say there's an insurmountable chasm between him and the rest of his readers might be a bit of a stretch.
But hey, if you want to sell your unique genius as your upscale consulting brand, I guess this is how you market yourself.
The word you should have used is authoritarianism, which this writer has, alas, in spades.
Your users are more important than your sense of self worth, in this industry.
Nobody ships ego. We ship working software: to users who find it valuable.
I agree that's what's most likely to bring you financial and reputational success, but I also think there are a lot of things people can and do sell that are various incarnations of snake oil, at best.
This perhaps gets a little philosophical, but: is it ethical to sell someone something they don't need, and doesn't actually help them, even if they believe they need it, and over time even believe they've been helped by it?
I think a lot of the applications of "AI" today can fall under that umbrella, given the "right" customer.
It would only be unethical to remove their agency over the decision, in my opinion.
I don't find myself conducting much authoritarianism but admittedly I do keep a pretty tight grip on the movements of my budgies. It's for their own good you see.
For me the writing felt authentic and entertaining. Emotionally charged but rightfully so. It is incredibly disturbing to see people lying with a straight face and getting insane investments.
But he's still nowhere near as unhinged as the rabid AI bullshittery shitting up the airwaves for the past year
Not a lot of room for nuance when the subject matter is this polluted. Typical HN convention of preferring nuance to outright dismissal is bad at filtering BS
I personally would stay far far away from either of these two camps.
Very true. A thread about it here is a hat on a hat.
The very sort of hypemongers and grifters the author complains about often hide unsustainable claims behind complicated language and opaque terminology, with the intent of portraying themselves as experts and making clear-headed criticism seem uneducated or uninformed in comparison.
The author here is making a deliberate choice to use a ranty tone to cut through that sort of bullshit, and in doing so, successfully expressed his frustration with the pervasive level of hype in AI discussions.
Still. I prefer self-deprecating. Maybe you don't get seniority in his space if you don't sell.
But yes. Clearly self aware. Just doesn't care. Which is fine too: it's his blog.
At the time, we only used the term AI if we referred more than just machine/deep learning techniques to create models or research something (thinks operations research, Monte Carlo simulations, etc). But it started to change already.
I think startups and others will realise to make a product successful, you will need clean data and data engineers, the rest will fill follow. Fundamentals first.
All the startups trying to sell "AI" to traditional industries: good luck!
I've worked as an AI engineer for a big insurance, contractor with a bank, and oh gosh!
Monzo is the biggest new player in the UK and it's not making much of a profit. Revolut doesn't have a banking license because it can't comply with the regulatory requirements. Starling has taken much more of a conservative path and is being led by an ex-Barclays person, but even it is being investigated by the FCA for having poor controls around financial crime. All of those giving loans have unnaceptably high % of defaults from an investor perspective.
I still don't know what the answer to that question was supposed to be. We scraped coupons from our competitors then displayed them on our websites.
It seems like HN comments are shifting from technical focus toward:
* Early Reddit's low-effort but tame "snark"
* Aggressively moralizing posts dismissing sardonic criticism as dangerous mental illness
I haven't seen much of OP's style lately, especially since n-gate[1] went inactive.
I'm wondering whether that's a bad thing. Although the tone is hostile on the surface, there's usually some aspiration toward competence associated with it.
[1]: http://n-gate.com/
I get we are semi-autistic nerds and can't appreciate comedy/satire/sarcasm, but comedy/satire/sarcasm is a potent means of criticism and analysis, especially since we are in an ever-increasing torrent of bullshit.
What qualifies as skepticism versus cynicism is often in the eye of the beholder.
> are more a statement about the perceiver than about HN itself
I may have some rose tint to my oldest memories of lurking HN. Not only was I younger, but I was also seeing hours-old threads instead of comments arriving in real-time before any sorting or flagging.
In other words, thank you for maintaining the site all these years.
It's ok though, because the perception "HN isn't what it used to be" is somehow part of the overall system.
Some of your comments are getting killed by software filters. Those are tuned more strictly for new accounts, for reasons which aren't hard to figure out.
I don't think any mods even saw your comments (before now)
Which is a pity. The style is excellent & so wonderful, is a critical relief, after suffering through insane out of this world hype-bordering-religion. At least to me; he doesn't read as menacing, he reads as being on a justifiably distraught polemic against total madness that's allowed to pointlessly suck up all the oxygen in the room.
We should be flipping our shit (if not each other) that we have to put up with this endless exuberant schucksterism. That robs us of agency & pollutes our noosphere with inauthentic bullshitting.
But if you don't tell anyone, I won't tell anyone.
https://news.ycombinator.com/item?id=40736501
Let me know if you need any further help with the subject.
(My prompt: "okay, do it again, but this time change the tone to be cheerful and encouraging and not so flat.")
Ludicity: Embracing AI Innovations with Caution and Care Published on June 19, 2024
The recent advancements in AI, particularly with developments like GPT-4, are undeniably reshaping our world. These innovations have the potential to eliminate mundane tasks, revolutionize industries, and even pose existential questions about our future.
As someone who has formal training as a data scientist, having excelled in a competitive machine learning event at one of Australia's top universities and written a Master's thesis with custom libraries in MATLAB, I have a unique perspective. I may not be the best, but I am certainly experienced and knowledgeable. So, it's with a mix of concern and optimism that I urge caution in our enthusiasm for rolling out AI everywhere.
Balancing Enthusiasm with Reality
I began my journey as a data scientist in 2019, and by 2021, I realized that while the field is vast and promising, it's also filled with misconceptions and overhype. Many leaders in the industry seemed to push AI initiatives without fully understanding them. The market saw a surge of companies jumping on the AI bandwagon, often without clear use cases, driven by hype rather than genuine need.
Despite the financial rewards, I transitioned to data and software engineering. Unlike those who chase trends for short-term gains, professionals like us value job stability, meaningful relationships, and genuine contributions to our field. The transient nature of hype-driven careers contrasts sharply with the steady, rewarding path of continuous learning and improvement.
Practical Advice for AI Implementation
Instead of blindly adopting AI, focus on the fundamentals. Many companies struggle with basic applications, yet they aim to implement complex AI systems. It's essential to ensure that your organization has the necessary infrastructure, skills, and culture before diving into advanced technologies.
For example, many businesses haven't mastered basic IT operations like regular database backups. Improving these fundamental practices will better position your company to leverage AI effectively when it's truly needed. Emphasize collaboration, clear communication, and mutual respect in problem-solving. This approach will yield more reliable and sustainable results than any rushed AI implementation.
The Future of AI: Opportunities and Challenges
Generative AI, like ChatGPT, has shown remarkable potential, but it's important to distinguish between practical applications and unrealistic expectations. AI can indeed revolutionize industries, but only if used thoughtfully and strategically.
If your company has a clear, well-defined use case for AI, by all means, pursue it. However, for many businesses, the priority should be on improving existing operations and culture. AI will naturally integrate into your processes as it becomes relevant and beneficial. Remember, technology should serve to enhance your capabilities, not distract from core objectives.
Encouraging Thoughtful AI Adoption
Let's approach AI with both enthusiasm and caution. Recognize the incredible potential while also being aware of the limitations and challenges. Embrace AI where it makes sense, but always prioritize the fundamentals of good business practice.
In conclusion, the journey with AI is exciting and full of possibilities. By focusing on solid foundations, continuous learning, and thoughtful implementation, we can harness the power of AI to create a brighter future. Let's work together to make sure our advancements are meaningful, sustainable, and truly beneficial.
Thank you for reading, and let's continue this conversation with positivity and a shared commitment to excellence! If you have any interesting work or thoughts to share, feel free to reach out at ludicity.hackernews@gmail.com. Stay tuned for more insightful discussions, ambitious projects, and exciting developments in the world of AI and beyond.
I'd so have preferred this to be true, and to ignore the AI thing (mainly to avoid any effort to change any of my habits in any way). But as an end user I can say that this is wrong. I definitely need LLMs for one critical thing: search that works.
Google has become clogged with outright spam and endless layers of indirection (useless sites that point to things that point to things that point to things, never getting me to the information that actually fucking matters), but I can ask the best LLMs queries like "what's the abc that does xyz in the context of ijk" and get meaningful answers. It only works well when the subject has a lot of "coverage" (a lot of well-trodden ground, nothing cutting-edge) but that's 80% of what I need.
I still have to check that the LLM found a real needle in the haystack rather than making up a bullshit one. (Ironically, Google works great for that once you know what the candidate needle actually is—it just sucks at finding any needle, even a hallucinated one, in the first place.) For shortest path from question to answer, LLMs are state of the art right now. They're not only kicking Google's ass, they're the first major improvement in search since Google showed up 20+ years ago.
Therefore I think this author is high on his own fumes. It reminds me of the dotcom period: yeah there was endless stupid hype and cringey grifters and yeah there were excellent rants about how stupid and craven it all was—but the internet really did change everything in the end. The ranters were right about most of the battles but ended up wrong about the war, and in retrospect don't look smart at all.
"Recycling things people have said before" is basically search, and that is hugely valuable and quite enough for me. If it's genuinely generative, that's a cosmic leap beyond search.
My guess is that it's not genuinely generative, but rather that the long tail of "everything that everyone has said before" is so vast as that it feels like magic when it's retrieved.
But LLMs have shocked me enough on the search front that I'm no longer smugly confident about this.
I'm not much of an LLM user, but the few times that I did turn to it for programming advice was in rare and obscure situations that weren't really discussed anywhere on the internet (usually because they contained multiple issues in one). The LLM tended to produce something I'd call a reasonable answer, especially on topics that weren't completely obscure.
But we don't even need to go that deep to answer the question. For example, if an LLM was pure search, you couldn't make one generate text in some specific style or with specific constraints, unless that exact answer already existed somewhere on the internet. They can mash up ideas or topics, and still output good or reasonable data.
The billion dollar question isn't whether it's generative - it's whether the generative capabilities are "enough". Machine learning is about finding patterns, and a complex enough pattern finder will be very good at approximating answers accurately. LLMs don't actually have an accurate "model of the world" learned - but they have something that's just close enough on certain topics to make people use it as if it does.
It's not meant as a criticism of ChatGPT and some LLMs, more like a criticism of corporate drones and "thought leaders" that latch on latest hype instead of fixing their core problems.
What interests me is that there is new technology here that does something relatively magic - that just doesn't happen often. Corporate crap and MBAs and suits and founder hucksters are forever with us. I'm sure it was equally true decades before me and you showed up.
I'm rather annoyed that this is so, because now I have to slightly get off my ass and learn something, so as to reach a better state of lethargy later.
I'm a ranter by character, but you know who I'd pick between the ranters and the drones? The drones. The drones are the 100 million sperm racing to fertilize the egg. They're all losers (save one infinitesimal winner) and it's easy to point that out. The ranters stand on the side saying "those fucking idiots. those morons. what losers they are. as opposed to me, who sees this." But the ranters are the dead end, smart as they may be. The sperm are at least in the race.
Indeed, I think this is a key area where regulation is needed. If answer from AI is influenced by 'something unexpected' - what ever that might be, then it has to be clearly highlighted in the answer.
Hmm, that seems weird.
> Google has become clogged with outright spam and endless layers of indirection
So.. the problem isn't search, it's that Googles ad business has destroyed googles search and created spam to try to get ad clicks.
I switched to Kagi a few months ago and I'm much happier. Most of the blog spam is just gone, and the things that slip through I can nuke.
Still though, the way that LLMs can give customized answers to complex specific questions, questions that probably don't have any specific page on the web, feels like a leveling up beyond traditional search engines.
here's a recent example: I asked how to call a particular function in some library from a little-used language, and it not only told me exactly how to do it but wrote the FFI wrapper. I could definitely have dug that information up but it would have taken a lot longer and then I'd still have had to pore over documentation to write that tedious code.
If you ask an AI for historical pictures of Hitler shaking hands with Zulu fighters, you might get them, but you'd be a fool to think that's facts. Text is exactly the same. The tech is exactly the same. The result is exactly the same. People are just so used to text being about facts via school that they are fooled, but they know about paintings from before kindergarten.
Your example isn't about facts or search though. In the case of code we can easily check the result. It's not a case of facts really.
I really didn't have any illusions on the article after reading this - apparently the author believes that anyone who hasn't written a C library is below him.
And also, this author is known to make articles that are full of ranting and have rage titles, for example https://news.ycombinator.com/item?id=34968457
I'd really like to read it that way, but I'm afraid he actually did come across that arrogant.
“I'm not God's gift to the field, but I am clearly better than most of my competition - that is, practitioners like myself who haven't put in the reps to build their own C libraries in a cave with scraps, but can read textbooks and use libraries written by elite institutions.“
It’s quite poorly written, but they note they’re clearly better than most of their competition.
Yup, I've noted that three times. Are we still claiming he wrote libraries in C in a cave with scraps? Or just moving on?
Poorly written? Maybe. Poorly read? Equally likely. Maybe we should just ask the guy, he'll know.
Did the downvoter see me as their "competition"? "Clearly better"? Both? I don't have enough karma yet to respond in kind, so they're right about something at least.
lol they did it again. mods!
There seems to be a comprehension issue on one side or the other. Can someone point me to where he says his competition has never written a single library? I only see that he says they haven't written a library "in C in a cave with scraps". Where does he say he's written libraries in C? I don't see that either. Maybe the words "scraps" and "scratch" are too close together? If a subset of readers are inclined to dismiss him out of hand for this perceived slight, nothing I write will convince them otherwise, but that doesn't make their uncharitable interpretation of his words the correct one.
Nobody here but you is taking the "cave" and "scraps" literally. It'd be total nonsense if taken literally. Like, what would it even mean? It's obviously the author trying to make their writing punchy. You should not take it any more seriously than their threats to snap people's necks for talking about AI.
If you want to ignore than actual discussion and steer it toward a discussion of an interpretation of the text that's so literal that the text doesn't even make sense, you should probably be very explicit about it.
"Please respond to the strongest plausible interpretation of what someone says, not a weaker one that's easier to criticize. Assume good faith."
"Please don't post shallow dismissals, especially of other people's work. A good critical comment teaches us something."
:)
If you subdue the urge to write him off based on his emotionally expressive writing, you'll find a lot of poignant observations you wouldn't get from more civilized venues (e.g. HN, famous tech influencers, thinkers, and execs, etc.).
Ludic's blog is a one-man 4chan board, minus the racism, sexism, and so on.
Uh yeah that's a bit like telling the same joke over and over. In fact it is the same joke.
There is industry-changing tech which has become available, and many orgs are starting to grasp it. I won't deny that there's probably a large percentage of projects which fall under what the author describes, but these claims are doing a bit of a disservice to the legitimately amazing projects being worked on (and the competent people performing that work).
Consultants are obviously making huge amounts of money implementing LLMs for companies. The question is whether the company profits from it afterwards.
Note that I don't usually work in that particular space (I prefer simple solutions and don't follow the hype), didn't sell myself using 'AI' (I was referred), and also would always tell a client if I believe there isn't much sense in a particular ask.
This particular project really uniquely benefits from this technology and would be much harder, if possible at all, otherwise.
Especially about ChatGPT et al. - I use it daily, but having the proper foundation to discern and verify its output shows me that it's still very far from being a competent programmer for any but the 'easy' tasks which have been solved hundreds of times over.
Like I hinted, I also view all of this hype sceptically. I dislike the 'we need AI in our org now!' types and am not planning on taking on projects if I don't see their viability. But there's obviously still a lot of demand and people offering services like those in TFA who're just looking to cash in, and that seems to work.
If you can find projects you believe you can make a difference in with your background, why not give it a shot?
> I'd say it depends on what your other options are.
> why not give it a shot?
Your right. If it fails because of automation by ML, most other career paths in the tech sphere would do, too.
That’s because most of them are still in progress. Enterprise moves slow and only started on this recently. They still think it’s going great because they’re riding the high of imagination.
I mean, contempt is literally the only sane and appropriate emotional reaction to the amount of lies, and it is intentional lies, that are being marketed to people.
ML has been around for decades, DL for more than a decade.
In 2019, I had to explain to executives that 95% of AI projects fail (based on some other survey), top 1 reason is bad or missing data and top 2 is misaligned internal processes. I probably still have the slides somewhere.
One project I worked on was impossible because the data was so bad that after cleaning, we went from 4M rows to 10k usable rows in 4 languages. We could have salvaged a lot more if we restricted the use case but then the benefits of the projects would be not so interesting anymore. The internal sponsor gave up and understood the problem. Instead, they decided to train everyone on how to improve data entry and quality! In just 6 months I could see the data was getting better indeed. But I had to leave this company, the IT dep was too toxic.
So I think the author is right. According to Scale, we'd have gone from 95% failures to 95% successes in just 4-5 years just thanks to LLMs? This is of course ridiculous, knowing the problem was never poor models.
What? You know AI has been around since before ChatGPT.
This was true of web tech in the 2000s, social media and mobile apps in the 2010s, crypto, now AI...
There's substance behind most of these topics, they're intellectually interesting, useful to people etc., but they tend to be largely grift, hype, office politics, narcissists tryina narcissist.
Yes but it does save me a whole bunch of time writing boilerplate command line entries in argparse. I can give it a table definition and ask it to write a bunch of crud methods instantly. I can do all of this myself but why?
Of course the stuff it produces doesn't work all the time but then I'm not asking it to write my entire app. I'm asking it to spare me the tedium of iterating over the building blocks so that I can get to the main part - building things.
https://www.reveddit.com/v/singularity/comments/1bdjf7u/is_t... - The mods deleted the content of the question and the whole question itself.
Go figure!!
This is the original question
=====
Is the power of AI companies basically their ability to outbid for AI accelerator chips?
It seems to me that all the hype AI companies are getting is primarily due to the ability to outbid competitors for scarce AI chips, or even design and/or build their own. This also includes their ability to build their own infrastructure around them.
IMHO this scarcity is the main source of their high valuations, and it seems that in the long term when chipmaking capacity builds up this advantage will eventually wane.
Having the ability to train on information provided by users and customers is also a factor, but that doesn't look like it will last either
=====
There is meat to recent advances in Machine Learning…but the revenue / savings for actual businesses will need to start coming in if this hype is going to be sustainable for the next 16-24 months.
Clickbaity article aside there’s tons of legitimate uses of LLMs for corporations of all sizes
Now blockchain on the other hand…
FTA
"Everyone is talking about Retrieval Augmented Generation, but most companies don't actually have any internal documentation worth retrieving. Fix. Your. Shit."
> 5. Code generation /Review
FTA
"If another stupid motherfucker asks me to try and implement LLM-based code review to "raise standards" instead of actually teaching people a shred of discipline, I am going to study enough judo to throw them into the goddamn sun.
I cannot emphasize this enough. You either need to be on the absolute cutting-edge and producing novel research, or you should be doing exactly what you were doing five years ago with minor concessions to incorporating LLMs. Anything in the middle ground does not make any sense unless you actually work in the rare field where your industry is being totally disrupted right now."
The man trots out his bonified's at the start and in the article. He's inside and backing up that rage.
I read up about Copilot as part of some internal research, and absolutely the first things to do for Copilot (I'll copy-paste just the line-item headings from the section entitled "Prepare your data for Copilot for M365 searches") is:
- Clean out redundant, outdated, and trivial (ROT) content.
- Organize content into logical folders and sites.
- Tag files with keywords.
- Standardize file names.
- Consolidate multiple versions.
- Promote data hygiene habits.
Sigh. If I could do all this at an organizational level, I wouldn't need copilot at all.companies have tons of document libraries and documentation that need sifting through and are generating more content regularly and => RAG and vector search is game changer with real value there
Eg we implemented RAG + vector search at a manufacturing company and it changed their workflows entirely
And to coding with LLMs, Say what you will about AI coding but code review/linting and LLM created unit tests are as itself game changing as IDE intellisense this value is worth at least one junior developer on the team - that’s 70k yearly salary alone benefit
If you asked a company to run for a week, based on what its docs said, and nothing else I suspect it would be bankrupt before Friday.
Knowlege is tribal, human, and adaptive.
AI did this once already. Harvesting the data from professionals for expert systems... The problem is you need to keep feeding it data... the people dont go away, they aren't doing the job any more, they are just documenting the job at that point.
And (theseFeets) in (yourNutz).
> I'm going to ask ChatGPT how to prepare a garotte and then I am going to strangle you with it, and you will simply have to pray that I roll the 10% chance that it freaks out and tells me that a garotte should consist entirely of paper mache and malice.
Sadly it’s got a much greater than 10% chance of getting a garotte wrong.
welp
There's a lot of value in this statement, regardless of how you feel about AI, etc.
We really should fully fund the FTC and anyone else who can help fill the cells in "Thought Leader Jail".
Nailed it.
Block chain has no use.
AI and quantum hage obvious uses if they work.
Quantum is not close to working now. It's where AI was at in the 80s/90s.
AI may not be perfect but there is no denying that the GPTs were a dramatic shift.
IT was a massive leap forward for a 50 year old idea.
IF it takes another 50 years to make a leap of equal size, we might get to AGI before the heat death of the the universe.
> I don't see how AI, quantum and block chain are at all equivalent.
If we shut them off tomorrow what do YOU need to replace in your life without them?
A translator and editor would be nice? I use GPT to give feedback on my writing. It works well, especially suggesting other ways to word things. This is something I didn't even know I needed.
There are all kinds of other uses. It has offered advice to me on programming language design, approaches to math proofs, etc.
Again, I don't NEED these things, but yes it makes it a lot easier to have that there.
Just like I don't NEED google. I could scan through hundreds of thousands of websites or hire someone else to do it. But it's just easier to do that myself.
AI is nowhere close to delivering on its promises. But it's pretty useful for many tasks.
Quantum computers are vaporware. Quantum sensors are already here and game-changing. But just like AI, has failed to live up to hype.
---
Crypto is already here and makes good on its promises: decentralized finance.
Full disclosure: I do not own any crypto besides negligible sums in forgotten wallets.
It's not that there is any claim to equivalency, its that these are the technology trends that are most useful - the trend itself, nevermind any sort of usable technology - for those who grift.
There's a difference between something being an extremely hyped development and it being an actual grift down to the core. The internet was an extremely overhyped development, but ultimately not a grift. Cryptocurrency was, to a large extent, both. Whether generative AI is one or the other won't be apparent until a bubble truly starts growing.
Most people don't really comprehend how much money there is in the hands of people at the top that just... falls down to whatever random stuff those people are getting worked up about at the moment. The vast majority of it ends up being nonproductive and it really does get allocated based on what those people see in their Twitter feeds. This is a much more pronounced problem than it was 20 years ago because of all the money printing governments have done, in general if you are connected to the government and banks, you will be the largest beneficiary of that type of action. None of this stuff is really subjected to market economics, it either flows through some kind of government/NGO bureaucracy or from someone who controls a monopoly or something similar to one. The waste and inefficiency in this modern pseudo-command-economy is mind blowing to behold.
The author is an idiot who is using insults as a crutch to make his case.
“‘This is the real thing, this deserves respect!’. It isn’t and it doesn’t, and no one cares.”
As a former-PhD-Data-Scientist-who-quit-the-industry-because-it-was-full-of-fraud-and-went-back-into-software-engineering-and-is-now-an-Australian-consulting-to-Americans, this is even more hurty. Someone sent this to me and I thought I'd dreamposted it.
Great article, the anecdotes physically pain me in the same way that watching Utopia does.
It is totally lost on many here, some of whom equivocate the rant with serious threats of violence.
Personally I found it very funny and an accurate portayal of industry trends
1. Customer service - seems like natural language processing by AI could be a better offering than someone manually trying to resolve problems. I have been in front of many CS agents who couldn't do what I wanted them to do. Untrained CS agents, non native speakers, or people who just don't care enough to help.
2. Internet search - I don't have to search through arbitrary articles and text to get the answer I want. Now its not always accurate or the latest, but still better than scrolling through Google search (feel bad for the publishers and writers though - they aren't getting the same ad views as before and clearly not ideal)
3. Summarizing - AI does a fabulous job here - TLDR and more.
4. Rewriting things to a better tone - AI is going an amazing job here, every time I get stuck on how to write something OpenAI has helped me. Now I don't use the output as it is, but it gives me an idea of how to write my own message.
5. NLP interface to devices / tools = I think this is a really valuable use case.
Almost everything I suggested here is pointing to a $20 or a fixed monthly subscription for individual user. I don't know if its an "enterprise" need. Except for the customer service use case.
And the smugness feels especially unfounded because the author clearly has decided to double down on their views even though it’s not at all evident that they’ve taken the time to interact with the tech as an end user (which millions upon millions have, last time I checked). They’ve just not gotten it, or: yes, it is you, not me.
This is just another form of rote, unthinking (anti) hype. It reminds me of the smugness that Balmer had towards the iPhone.
It is not this.
There is actual anger there, he's pointing out WHY he's pissed.
> it’s not at all evident that they’ve taken the time to interact with the tech as an end user (which millions upon millions have, last time I checked)
He covers this point, in depth in the article. From a few angles.
Don't know what to do with AI, Ah fuck it let's just shove it with FOI and GDPR
I really dislike articles that have rage against (x) and try to appear smart and with authority to tell you that everyone else is stupid and they know better but deep down they are just anti-everthing because contrarianism is the target here and not AI or anything that any article like this talks about. The idea is to just say "no, it's not like that".
Are you stuck in 2005?
Don't be daft. It's boring.
While the title seems to express a widespread annoyance at the overwhelming prevalence of this subject in the tech news, the body of the article then goes on dedicate itself to the exact topic the title claims it doesn't want to hear about.
I for one really do wish someone/something would piledrive this topic, but this article was just more of the same tripe...
Also, I attend an online Microsoft meeting every week where they inform the attending community about all the new changes and technology coming from MS.
I'm utterly sick and tired of hearing about "AI" and Co-Pilot from them. every. signle. meeting. is 90% AI/Co-pilot.
I'm over it. I'm burnt out on it as a product.
That's true, decent people write import torch.
>Just Use Postgres, You Nerd. You Dweeb.
I'm really sick and tired of kids coming in and shitting on what we had to do to search a tb worth of data in 2009 (or 2004).
A computer in 2019 (or 2024) has enough power to run postgress queries to extract statistics from columns.
Yeah, great.
Now try running that stack on an iphone 7 and report your results back. We didn't create all that complexity for shits and giggles, we did it because it was at the edge of what was possible and the companies that got it right made billions.
Why?
But the title (as phrased here on HN) is exactly how I felt at Google IO this year.
backs away slowly
Fucking internet.
edit: those knocking his style i think may miss the point that hes acting. its a show. noone is like that. (i hope)
Editorialized & not the title of the post.
I confess to being a bit self-indulgent in coming up with the edit—I thought it would be hilarious to flip it to something meek and passive aggressive.
Normally when we edit a title according to that guideline, we search earnestly for a representative and neutral phrase from the article itself. In this case "earnest' and "neutral" aren't much of a fit so I felt it more in the authorial spirit to troll a little.
Since the original author submitted I thought it was misleading.
> I Will
Ok in principle but already pattern matches to dodginess
> Fucking
That's a noise amplifier—can be ok if the rest of the title is whimsical, but in most cases it's just ponderous
> Piledrive
Wtf? that's extremely aggressive. "I will do to you what professional wrestlers do to those whom they are violently defeating, except without the training not be terminally injured by it"
Hot language like that may be ok if it gets balanced by other things (but in this case there are no other things)
> You
"You" is a linkbait trope. In this case it doubles down on the aggression—not just "i will piledrive" but "I will piledrive you". What did you have to do with it?
> If You Mention
The superfluous you again, plus the word "mention"—what's wrong with mentioning things? This is a rhetorical trcik to drive up the menace: "don't you dare mention $thing you piece of shit"
> AI
The commonest hot topic du jour. Ok, but there'd better be something substantive to balance the buzzword. Is there?
> Again
Rhetorical escalation. You are mentioning Ai AGAIN? I will fucking piledrive you.
Conclusion: not a word in that title isn't linkbait. Take it all out and you end up with the empty string.
/s
on a serious note, to me this field was already in quagmire of bs marketing the moment they named it "AI" almost a decade ago. in retrospect, seems like naming it "data science" was the move that started it all. but then political sciences get away with it, but i should not be picking multiple battles at the same time.
lowkey grifting has been part of the r&d space in the corporate world from as long as i can see. but lately i am afraid that the bubble will ruin it for all of us.
It would be so much bolder and more mature if he threatened to run with scissors or hold his breath until he turned blue ;)
He may have some good points but might be more detracting than helping them stick.
This entire comments section is exemplary of the industry at large. We're doing fucking _engineering work_ "professionally" and the bitching is 50:1 on his tone versus his actual ideas.
The entire professional class has been brought to its knees by a culture that demands we tiptoe around everyone's insecurities.
This is purely wishful thinking. We're good at making rigorous well-organised stuff and we hope that will somehow continue to be a useful skill. But actually there's no evidence that a half-baked bullshit generator isn't going to outperform carefully written documentation, to the point that carefully writing documentation becomes a waste of resources.
> I swear to God, I am going to study, write, network, and otherwise apply force to the problem until those resources are going to a place where they'll accomplish something for society instead of some grinning clown's wallet.
Bet. Go on, actually have a go at doing this. You'll find it's much harder than you think and what looks like success will usually turn out to be actively counterproductive.
Mostly the world has to sit back and suffer for this clown car of over enthused business types promising us that their AI will make all our lives better. Mostly the world has to let this weirdly quasi-cultish hype run unchecked.
I'm frelling pissed about it. I frelling miss personal computing being an aspiration; I wish we were actually improving systems. Instead we're investing billions to make machines good bullshitters. It's enormously relieving seeing such rancorous disgust on display here.
The article follows the format of sections with titles as interrupted quotes from people "mentioning AI" and the author shutting them up, let's see what amazing arguments they offer for "not talking about AI"
" "III. We've Already Seen Extensive Gains From-" When I was younger, I read R.A Salvatore's classic fantasy novel, The Crystal Shard. There is a scene in it where the young protagonist, Wulfgar, challenges a barbarian chieftain.... "
Just at a glance, we have business people on one side talking about income and how to increase it. On the other we have an enraged nerd talking about his favourite high-fantasy fake world. Gee, I wonder whose side I should be on, is this an ad for AI hype?
" Well this is me. Begging you. To stop lying. I don't want to crush your skull, I really don't.
But I will if you make me."
... Is OP threatening us?
I say this unironically now OP, this sounds like schizophrenic, I won't suggest you "take your meds", but at least consult a psychiatrist if you haven't already.
They sure are spending a lot of money on graphics cards!