52 karma · joined May 4, 2023
The public's inability? What about everyone's inability. No one deals well with epistemological problems on a systematic scale, not even the technologists who delude themselves into thinking that they're driving anything.
I am exactly talking about psychological limits. The difference is that I don't think the psychological limits of the creators are any different from those of the users. If anything, I think the creators are more psychologically limited than the users. This is because the creators need to explain to themselves why they are creating the thing - everyone else just puts up with it. When you say ppl will either be duped or completely check out of discourse, don't forget about yourself.
Also, of course I didn't read the article....
IMO "truth" is distraction here because what is at stake here are people's values, not their understanding of math and physics. When people worry about "post-truth", they're worried about liberal values no longer being the unquestioned default. It is absolutely a marketplace, and if people switching marketplaces en-masse makes it harder to launch rockets and develop vaccines, then it probably means those activities are making people net unhappy. People are a lot smarter than we give them credit for, even the dumb ones.
Things are hyper-polarized right now and there is no magic political synthesis that is right over the horizon if only we could just keep discoursing a little bit more. This is like a heroin addict thinking they'll cease being addicted after that last fix. The solution is to cool things down.
It's technocratic hubris to think that there is just a single such arena and that all the others are illegitimate/dangerous.
There's a weird magic trick that social media companies have played on people to convince them that the text and images consumed on their websites are socially/culturally/politically relevant. Once it becomes clear how easy it is to fake that text people will come to understand how cheap and irrelevant "opinion" has become and this magic trick will become weakened.
I think technologists rarely, if ever, talk about this because a lot of what enables our blind pursuit of technology is to say that technology must be an extension of humans and so it can never become autonomous. When ppl talk about AGI and paperclip maximizers, I think it's a way of pushing the problem far into the horizon and ignoring that the boundary is fluid and pushing.
Imagine if all the people at Google and Facebook stopped thinking that they're making the world a better place?
I'm not Pope Francis's biggest fan, but even a cursory look into ecclesiastical history reveals that the stuff happening nowadays is mild compared to what's come before. It breaks my heart to see people who are reacting so strongly against modernism embody modernism so thoroughly by insisting that the "now" is so tremendously unique and special from "the past". To the point that it's OK to ignore that history, because what is happening now is unprecedented. I think this willful disconnection from history/context/embeddedness/belongingness is essentially what modernism is, and people are low-key starting to figure out that the result of this mindset is mostly depression and misery. There's a lot of money and influence to be had by boosting this mindset, but that crap has never been known to make people happy.
That negative self-conceit (i.e. "nowadays is the worst") is still self-conceit, and manifests itself in a fetishism/idolatrazation of the "the past". It's all very strange, but I can understand the allure.
The bomb had effects, but it didn't change anything. We still go to war, eat, sleep and get afraid about things we can't control.
For a moment, stop thinking about whether bombs, AI or the printing press do or do not affect history. Ask yourself what the motivations are for thinking that they do?
The right-wing is tired of the California ideology, is invested in the primary and secondary sectors of the economy, and has learned to mistrust claims that the technology industry makes about itself (regardless of those claims are prognostications of gloom vs bloom).
The left-wing thinks that technology is the driving factor of history, is invested in the tertiary and quaternary sectors of the economy, and trusts claims that the technology industry makes about itself. Anytime I see a litany of "in 10 years this is gonna be really important" I really just hear "right now, me and my job are really important".
The discussion has nothing to do with whether AI will or will not change society. I don't think anyone actually cares about this. The whole debate is really about who/what rules the world. The more powerful/risky AI is, the easier it is to imagine that "nerds shall rule the world".
Just because you can do fancy math doesn't mean you understand how to play the game.
Humans also don't grasp that things can improve exponentially until they stop improving exponentially. This belief that AGI is just over the hill is sugar-water for extracting more hours from developers.
The nuclear bomb was also supposed to change everything. But in the end nothing changed, we just got more of the same.
I can think of a myriad of use-cases for AI that involve custom-tuning foundation models to user-specific environments. Think of an app that can detect bad dog behavior, or an app that gives you pointers on your golf swing. The moat for AI is going to be around building user-friendly tools for fine-tuning models to domain-specific applications, and getting users to spend enough time fine-tuning those tools to where the switch-cost to another tool becomes too high.
When google complains that there is no moat, they're complaining that there is no moat big enough to sustain companies as large as Google.