The AI industry turns against its favorite philosophy
semafor.com
semafor.com
Let's not forget that benefit for humanity is also somewhat nebulous term, especially since humans can sometime have incompatible goals against each other. However, it's not impossible to have some kind of agreement, like making sure that we all have shelter, food, and water, and so forth.
The "Effective" part is immediate and drives short-term incentives like maximizing profit. The "Altruism" part is hypothetical and delegated to a future date where the resources acquired "effectively" are deployed for the benefit of humanity. In the gap between the two are fallible human beings, not necessarily more virtuous than average, that task themselves with making decisions about what's important.
The focus on hypothetical dangers like GAI is telling here. If you can invent an apocalyptic boogeyman that you're "addressing" by funding thinktanks and sitting on company boards you don't actually have to spend anything on addressing immediate issues.
Like the PR teams got together and intentionally conjured semantics that tickle the same biological responses seen in religious true believers.
Consider “religion” as a biological state, not an abstract philosophical framework. Behavioral economics has been leveraged to embed the hallucination that is American Civic Life similarly to embedding religious mind viruses.
Given what we know now in neuroscience, how we brainwave sync with rooms of people just by being there, the leadership class reinforces among themselves hallucinations of their right to reach into all of our lives and claim them for themselves, just like the church.
The longtermism stuff has always struck me oddly alongside those other obviously-beneficial causes. It's a bummer that's all some people think of when they hear EA.
What we chose to donate to are organizations like churches, museum, theaters, makerspaces, and the like. They enrich our lives in the neighborhoods we live in, but they're not exactly urgent as someone on the other side of the world dying to something perfectly preventable like cholera.
The "Effective" part is immediate and drives short-term incentives like maximizing profit. The "Altruism" part is hypothetical and delegated to a future date where the resources acquired "effectively" are deployed for the benefit of humanity. In the gap between the two are fallible human beings, not necessarily more virtuous than average, that task themselves with making decisions about what's important.
I do not agree that we should try to maximize our profit and then only help people at a nebulous distant point in time.
We all make priorities about things important to us. Some of that shows in what we chose to donate to. A lot of charities we donate to are not fundamentally urgent because they do not work on saving lives. A lot of EA is simply prioritizing what saves the most lives, right here, and right now.
The focus on hypothetical dangers like GAI is telling here. If you can invent an apocalyptic boogeyman that you're "addressing" by funding thinktanks and sitting on company boards you don't actually have to spend anything on addressing immediate issues.
They can be sincerely strongly held belief. The fact that OpenAI is actually...not doing anything remotely about it makes me discount OpenAI as a serious organization, regardless of the nebulous and hypothetical nature of GAI.
For the record, I don't think we are able to even remotely approach the problem if we can't take of issues of alignments of human actors. Once we figure that out, maybe we'll have a concrete path for aligning GAI should that or when it becomes a technological possibility.
The only resources we as people have are our actions. So, if you want to do some good, do it today. There's no shortcut and no reason to think anyone in the future will act other than precisely as you do now.
Is this altruism, or just utilitarianism by a different name? This is obviously a serious ethics question, and one that likely has no objective answer - but utilitarianism has run contrary to the morals of most societies, generally.
NASA has the Sentry program to look out for asteroids, with a budget of around $35 million, and the odds of a "big one" hitting in our life time is less than 1 in 10,000.
That said, the majority of EA spending is on global health and development to address immediate issues, on programs like Against Malaria.
The disconnect I see is that if there is even a 0.01% chance that is could threaten the existence of humanity, then why in the world would anyone actively pursue making it happen before figuring out a way to mitigate that risk?
Meanwhile, 11 hours ago over on Reddit a dude has connected a robot to ChatGPT. The robot sees and talks, and clearly has motorized limbs. All you need now is to turn verbs into servo commands:
https://www.reddit.com/r/nextfuckinglevel/comments/1811bct/m...
https://www.microsoft.com/en-us/research/group/autonomous-sy...
https://www.microsoft.com/en-us/research/group/applied-robot...
https://blogs.nvidia.com/blog/eureka-robotics-research/
https://www.vice.com/en/article/93kb43/princeton-uses-gpt-to...
https://techcrunch.com/2023/11/10/ai-robotics-gpt-moment-is-...
All we have now are faster, better, more powerful Elizas and as long as deep learning is the only tool we have, that's all we'll keep getting
"All we ARE now are faster, better, more powerful Elizas"
Is that all there is, but organic instead of digitally modeled? Organic brings in a lot of uncertainty and chaos. That, too, can be digitally modeled. Are we ghosts in our own organic machines, or are we simply those machines, hallucinating our own importance?
On top of this, the people trying to race to this eventuality are trying to convince us that any of this is possible to constrain.
Despite binging enough Ghost in the Shell to entertain all of the scenarios I still don't think AGI is anywhere near and I'm just going to mostly ignore the possibility. One of those distant existential things I have no control over so I'll try not to think about it too much :)
we don't want to start another "Your purpose is 'to serve man'" fiasco...
Those are the very best risks to motivate and manipulate people!
Plus there's no risk of nosey eggheads trying to explain "how it really works." Now we're completely into the land of untethered ego!
Self regulation of industries has never worked and never will.
I think it's a smoke screen term to convince wealthy people they have humanity's best interest at heart—pretty trivially. I find it impossible to believe that anyone else believes this.
This describes many who fell for crypto Ponzi schemes. Who were convinced that buying into the Ponzi scheme made them rich, and the world a better place.
Everybody else concerned about the future is concerned about climate change but EA is at first silent and then reveals itself as a climate denying movement when it does open its mouth as every other imagined threat, even ones with a 10^-50 probability seems to matter more for them.
But it is not accidental because isolation is one of the most important techniques of cult mind control. The point of Sequences is the same point as Dianetics it is supposed to rewrite the way you communicate so you just can’t relate to “wogs” (the rest of us) and can only talk to true believers.
https://forum.effectivealtruism.org/posts/xJhtrAxd5QpXi2CdA/...
Here is the Google query that came from
https://www.google.com/search?q=effective+altruism+climate+c...
https://forum.effectivealtruism.org/posts/pcDAvaXBxTjRYMdEo/...
But it is not accidental because isolation is one of the most important techniques of cult mind control. The point of Sequences is the same point as Dianetics it is supposed to rewrite the way you communicate so you just can’t relate to “wogs” (the rest of us) and can only talk to true believers.
Wow. This is just weird.
https://en.wikipedia.org/wiki/Snapping:_America%27s_Epidemic...
I read the first edition circa 1989 when people still remembered the moonies. When LSD got fashionable in the 1960s parents blamed it for what seemed like sudden personality change (Straight A student athlete now smokes dope all the time, grows their hair long, gets the crabs, etc.) but after the crackdown all the psychedelic bands either went under like the Beatles or changed the way the Rolling Stones and Pink Floyd did. By the 1970s the fear was much more that your kid would get ambushed at the airport and brainwashed or maybe even kidnapped like Patty Hearst and transformed into a revolutionary.
I found out about the 1995 edition circa 2005 or so and though first “gee that issue wasn’t so salient then” but no you had groups like Aum Shirikyo, Al Quadea, etc. that were not so prominent in terms of numbers but highly dangerous in behavior.
The Reaganite sirge in inequality makes EA quite different from the Scientology of old (which wanted to drain people of their money and then make them work like slaves) because back then it was worth emptying the wallets of ordinary people. An EA club at a place like Stanford on the other hand is really a potemkin village that creates the appearance of a movement, what matters in a group of 30 of them is 2 rich kid whales, the other 28 are there just to make it look like there is movement. (E.g. Scientology has moved into big ticket donations because they found ‘working people like slaves’ isn’t that profitable). What happened to Patty Hearst is close to the right idea for a cult in 2023 except you don’t want to kidnap them and encircle them, you want to encircle them in their own environment.
> 80,000 Hours rates reducing extreme risks from climate change a "second-highest priority area": an unusually pressing global problem ranked slightly below their four highest priority areas.
https://forum.effectivealtruism.org/topics/climate-change
You should point your climate denier accusations at someone, so readers can at least check that person's statements.
Saying the risk of climate change wiping out humanity is less than the risk of nuclear war doing so is not climate denial.
It may be wrong, but it's not climate denial.
At the same time (and to practice charity, as many in the movement recommend): it is also perfectly accurate to note that there is an opinionated wing of the EA movement that believes AI risk is the most important X-risk facing us, and influential members of that movement have certainly made statements downplaying the relative risk of climate change. They’ve also managed to get some agreement from portions of the broader community. (And it is also hard to deny that some of the latter elements of the movement seem to be gaining ground in ‘capturing’ the brand, at least as far as it’s known to the public.)
It's utter nonsense. It positions the person in question as some sort of arbiter of humanity's future, someone so intelligent and so well rounded as to see the folly of mankind itself as an obstacle to be overcome, not as a collective where we move forward together, but as a personal barrier to what you already know needs to be accomplished. It is arrogance without limit to assume that you personally know better what needs to happen than the total summed knowledge of billions of your fellow man and I cannot take anyone who self-identifies as an EA seriously as a result. You, singularly, are not qualified to "fix" the fucking world, you are not ABLE, let alone currently, to be qualified for that.
To be clear: There are TONS of problems that the resources of one of these jackoffs could solve basically overnight. Flint's inability to have clean water is a great example, but just buying a shit ton of pipe and having it installed in a struggling city isn't flashy, it isn't exciting, it isn't paving the way for the future: it's just fixing a problem we know how to fix and that should be fixed, but that isn't enough. You can't put your name on it, you can't get famous off doing it (outside of Flint anyway) and therefore it doesn't get brought up.
At the very minimum, that might have been the way it worked with previous grifter cults. You can sort of characterize those as the ones that were created for a single founder to exploit the cult for, money, sex, and adulation.
But, if these others are cults, then they're a very different sort. They do seem to want to communicate to others. That tends not to happen, as the other side seems to shut down communications one way or another (something like an immune response?).
> Everybody else concerned about the future is concerned about climate change but EA is at first silent and then reveals itself as a climate denying movement
I'm fairly sure your species is functionally extinct already. It's unclear why you're concerned about the future farther than, I dunno, 100 years out. While there are exceptions here and there, as a civilization you seem hellbent on wrecking your fertility. Any civilization that can't be bothered or otherwise refuses to create the replacements for those that will die of old age is already gone even if it doesn't know it yet.
Climate change isn't a problem, because 500 years from now there won't be anyone around to suffer it.
I don't know if you've had the experience of having a friend get into Amway and then giving you a long rambling nonsensical lecture about how they plan to make money at Amway that makes no sense at all... but you should because it's an education in how discourses with that structure play a role in mind control. You see them in Scientology, you see them in scam supplement ads on YouTube (it's genius that they ramble for 45 minutes before revealing what they are selling), and you see them in EA.
As for risks the cultural risks you are talking about are very real and not taken seriously enough although sometimes I wonder if the largest urban areas are just full and people who are living in a place that is full have an instinct to stop reproducing. If that's the case and there is a significant population drop it may turn around.
But I see them in the climate change people too.
The following pair of examples seems to piss everybody off. In one corner we have the person with conservative views who was just an ordinary person working, eating, sleeping and watching TV until some point in 2021 when they discovered purpose in their life because they would wake up each morning and read a lot about how everything the government about COVID-19 has done (vaccines, masks, closures, etc.) and not just wrong because people made a mistake but because of some deeply seated moral flaws in the political class.
In the other corner is a person who believes they have long COVID or who believes they are exceptionally vulnerable to COVID so when they see someone isn't wearing a mask they put on two masks. On their Mastodon profile they say they'll ban you if you ever post a selfie of yourself not wearing a mask. (I had a friend who used to be into all sorts of things like music festivals and Martin Scorsese movies but now all she wants to talk about is fashion face masks.)
The thing both of these people have in common, though they'll deny it, was their life was empty and meaningless doing ordinary things but now that they're suffering under fascist oppression or are under mortal threat by a virus every moment of their life is elevated. Either one will have a hard time accepting a "return to normal".
https://extropians.weidai.com/extropians/0303/4140.html is Yudowsky inventing the specter of a paperclip maximizer as a potential problem about 20 years ago.
He was, of course, the moving force behind both LessWrong and the https://en.wikipedia.org/wiki/Machine_Intelligence_Research_.... Both of which formed one of the three strands that later merged into https://en.wikipedia.org/wiki/Effective_altruism.
At it's core, I struggle to see how anyone can disagree with effective altruism as a basic principle. People want to do good in the world, but we're all monkey-brained and emotional, so that often manifests in ineffective use of time and resources to do things that give an immediate, visible outcome so we can feel good instead of what would actually do the most good.
EA to me is basically just shifting altruistic desires from emotional-payoff (volunteering at a soup kitchen around the holidays, donating to a local animal shelter) to things that have the best outcome (volunteering at a political action group to improve laws, donating to an NGO distributing mosquito nets in malaria zones).
I don't think anyone disagrees with that. The issue isn't the idea that we want to engage in altruism in the most effective way we can, the issue is the EA movement.
Sounds like ass-covering from people who are like 'I am ultimately rational and therefore must act with maximum effectiveness'. Ultimately rational as a perceived state within humans is a FEELING. You can take a bunch of ketamine and conclude that you possess that quality, and many people have done just that, some of 'em very wealthy and powerful.
Beats admitting the truth, I guess.
This lesson was brought home for me by https://www.amazon.com/Software-Estimation-Demystifying-Deve... explaining why the COCOMO model didn't work well in practice as an estimation technique, despite their having collected a lot of good data on what affects schedule.
This lesson is one that the EA community broadly seems to ignore.
It's not. What I meant by my comment was that pretty much everyone who engages in altruistic behavior wants that behavior to be as effective as possible. The EA movement did not invent or discover this, it's always been the case.
Even people whose altruistic behavior stops at dropping a few coins in the donation box at the supermarket wants those coins to be used in the most effective way.
The EA movement is something else entirely.
[1] https://www.businessinsider.com/sam-bankman-fried-coin-flip-...
> If you flip it and get heads, the entire world improves by more than double.
> If you get tails, the world is destroyed.
> Sam Bankman-Fried said he would flip the coin — and urged everyone else to do so, too, Caroline Ellison testified in court Tuesday.
This article absurdly misconstrues both recent changes in the community and Talinn's comments in particular. For people o take issue with the culture that has evolved around a philosophy is not for it to reject that philosophy. And for Tallinn to say that we should not rely on [initially] EA-motivated corporate governance to be benevolent is not for him to have disavowed EA's principles.
Is there an exception for helping my in-laws that live one step above abject poverty?
EA is radical in that it treats everyone's utility as equally valuable (across people, not income levels -- a dollar to a poor person is, all other things equal, more valuable than a dollar to a rich person). But you can do EA and still care more about your family than strangers.
It’s not some special new kind of cause, it’s just charity with an almost intolerably smug self-image.
But the idea of bringing statistical rigor to charity is an important one, and it really was a development -- it came shockingly late. Statistics came late to baseball too, and plenty of people fought the idea, but it won pretty fast, because people in baseball care about winning. If* people doing charity really care about achieving the most good, it will win there, too.
* This is a nontrivial assumption.
Anyhow, I will admit that the (putative) indifference to specific causes, so long as they are E and A, and (ostensibly) apolitical posture is original.
They are ofcourse transparently performative. Animal welfare cannot be measured but only assumed, and should therefore by their own “philosophy” rank lower than the lowest net positive measurable utility at any price.
Whatever else “effective” implies, it must include some change in society to be materially meaningfull. While this is not a standard the Longtermist arm adheres to, the rest of EA and the “philosophy” demand it. It doesn’t take all that much imagination to see which political project EA is most aligned with…