Out of curiosity, what would you like to hear him saying about non-LLM AI?
Whether LLM or non-LLM tech, the question of surveillance capitalism and how models need to be fed swaths of privacy-invading data (eg. self-driving cars filming everything all the time) is also a concern.
Overall, i think the ecological concern is still the biggest one. We are at the start of a major climate crisis, and any self-preserving measures were already hard fought by industry. I fear that any form of AI investment will lead (because it's already leading) to destroying any hope of saving an inhabitable planet.
I find a lot of the debate on either climate change or AI collapses if you point out that "we shouldn't do this, we should ALL just do this" is an extremely unrealistic position in an international complex ecosystem of competing actors.
No it's not. It's only if people like you are so defeatist about it. Look what happened with CFC gazes, leaded paints and asbestos. Sure we still have more problems to face but some problems are so serious that we can in fact gather consensus.
> an unsolvable problem that you need AI to solve
That is completely wrong on so many level. I understand you're playing the devil's advocate, but do you understand this is a messianic-level delusion that's made up by religious psychopaths so people buy into their products without thinking twice? If you don't have hope, the only rational solution is not to give in to AI, it's to Luigi Mangione or Unabomber your way to a better world. Personally, i choose hope: we can solve this problem (and every other, who strangely have more or less the same culprits).
I am probably on the pessimistic end of the spectrum, and personally I don't believe AI can solve it, but I can see that line of reasoning if what you believe the culprit is - is the sheer complexity of the coordination needed.
The term AI is very overloaded. When people say AI, they really mean LLMs. AI like old Siri has basically no cost. It’s not environmentally damaging, as it runs on device. It’s not privacy gore, because it runs on device.
Or take, for example, lane keep assist systems on vehicles. This doesn’t require a huge data center or anything, it’s basic computer vision and a small on-vehicle model.
Yes AI has a “cost”, but for virtually all non-LLM AI the ecological cost is the same as any other application or algorithm. Siri doesn’t burn more energy than instagram.
Yes, but it still has a strong ecological impact, and for what benefit? I only ever hear people complaining about electronics/assist in cars, and recalls due to electronic faults is about 50% of car recalls nowadays.
The problem is not that this compute is overall so much compute, it's that it's used to replace "no compute", and that in the ecological lifecycle of electronics production is the biggest problem (not sustained use). A modern car has hundreds of microcontrollers and probably as many sensors… Although some of these features are technically not machine learning, i think it's part of the same problem.
I wish we could have better/safer/cheaper cars over time, that can be more easily maintained. Instead we have shitter and more expensive cars that are less rapairable than ever before.
Computerization of cars is orthogonal, it’s not an AI problem. Things like engine control for fuel efficiency isn’t AI, it’s just an algorithm. Cruise control is just an algorithm. The cost is the same as any other software.
Now LLMs DO have a new cost. You really require super computers to run LLMs at scale, that much is true. But that’s very distinct from machine learning, it’s a different beast.
Nobody is complaining about, like, monster AI in The Binding of Isaac and how much ecological impact it has. Because it doesn’t. Well… that’s AI, and 10 years ago that’s the only AI people really talked about. Now AI really means LLMs. The ecological impact is from LLMs.