OpenAI's chaos does not add up
builtnotfound.proseful.com
builtnotfound.proseful.com
- At least two members of the board probably were genuinely more concerned about AI alignment
- Ilya may have been partially motivated by ego, Altman being the public face
- Microsoft had leverage: license to the models and code, and providing the compute. It expected profit incentives would keep people aligned.
- Sam needs compute hardware to stay in the space. Outside Amazon, Google and MS, who actually has the hardware, even if you have the money?
There's a bunch of people behaving with their own goals, and probably a misunderstanding of other people's motivations. People like Sam and Satya expect people to be self-interested and not tear everything down.
Sometimes people want a change in direction, but they don't have the power and end up decapitating instead.
We like to think that big execs and leaders are some super smart geniuses when we're not disparaging them (and they may be, but only in specific areas), but they're still just people, and they are afflicted with jealousy and envy and spite and lack of forethought just like the rest of us, and they make mistakes accordingly. They particularly make mistakes when you're trying to organize a big group of people.
After living for a few more decades you get a lot better at power plays.
This needs to be amplified + defensive caveat regarding subscription to any “youtube” theories. That said, a member of a large organization, such as the US military, will have many stories to tell and phrase “FUBAR” iirc came out of the US Army. In fact, even being in smaller commercial enterprises, one sometimes wonders that anything gets done at all!
But things get done. The military can plan, provision, conduct, and win wars. Systems tools and state-spaces are the tools of top level control mechanisms. So, yes, things can be chaotic when viewed from a narrow perspective, but from another top level perspective, there is order.
It's really hard to turn back on the "but realistically, conspiracies are uncommon" brain when exposed to the fact that actually decades-long conspiracies do actually occur and produce results.
[Caveat: I don't actually believe in shit like flat earth, and am skeptical of all conspiracy theories if their evidence is some shit like a 45 minute youtube video with their own sources of, idk, a blogspot post. But I do want to acknowledge that conspiracies have been reported on in relatively trustworthy news reporting sources, and that I myself find it really difficult to determine true vs fake conspiracy theories if multiple news reporters are contradicting each other.]
As you said, you don't send people into the street to yell at other people how the soviets are evil and we need to arm up. You rather plant ideas into the heads of a few influential people in hollywood, then give them cool toys and props for the movie, and let it roll downhill from there.
This is similar to work - and we're not large with ~150 techies in the company. But it has grown impossible to directly steer all different teams. Instead, you have to see that the right trailblazing teams are going into the right directions and possibly make sure that service requests moving into the right direction are quick, and service requests moving in the wrong direction.. well either roughly stay in the SLA or get blocked.
Bingo. I think there is also a factor of this being a non-profit board, where the board is not beholden to shareholders in the same way. For example, you presumably have no standing to sue a NP BOD for breach of fiduciary duty vs. a corporate BOD. I don't know the intricacies of the laws surrounding this, but I expect that the none-Microsoft investors in OpenAI who are seeing their investments dissolve in real time are probably asking their lawyers that right now.
Adam D'Angelo seems like someone acting in their own self-interest and that of his company, Quora. The move to bring in Emmett Shear at the 11th hour seems like a move right out of his playbook. What exactly does Adam stand to gain from a weakened or destroyed OpenAI?
It's not about Quora, which is a shit show either way, but it's about his AI chat company, Poe. Poe started customizable AI agents and also started their own store for AI agents - they were the first to do this. And Poe uses OpenAI API for this, they are essentially a wrapper company.
When OpenAI announced custom agents and store on DevDay, it was a fundamental threat to Poe, and a very strong conflict of interest for Adam. You also hear from everyone that things started getting sour after DevDay. I'm pretty sure Adam played his part in the shit show with his own motives.
https://www.semafor.com/article/11/19/2023/reid-hoffman-was-...
Makes it sound like they fired the wrong board-member. But it feels to this complete outsider like that board was totally disfunctional, even before the departure of Altman and Brockman.
I'm an LLM sceptic; I don't think these models are a route to intelligence, artifical or otherwise. I think that means I'm at odds with the four board-members that did the deed. But as far as I can see, there wasn't one member of that board, Altman and Brockman included, that was fit to run a whelk-stall, let alone a big company.
Before this, they were able to make things work - until someone said the quiet things out loud, and now they’re clearly going their separate ways while going ‘wtf just happened’.
Is there any evidence that Altman's firing was even related to AI alignment? All I've seen is people speculating about it.
Microsoft just saw chaos and made a very smart move before someone else could.
But yeah, morale is going to be pretty much in flux for a while. This has clearly disrupted OpenAI's ability to function and therefore contribute more to either research and/or productization. Sam and Greg going to M$FT only matter if their influence and leadership can bring the right people together. OpenAI had the right people to create GPT-3+, but now, seems like they won't. M$ST probably won't either.
Now each entity is actually weakened for a number of months I would presume. M$FT will try to push forward whatever productization of the current AI products it has access to. OpenAI will struggle to figure out if it's a pure research entity now or what.
But Ilya Sutskever is on the Time 100 Most Influential People in AI 2023 list, assuming that's the one you're referring to.
Do you mean [1]? Sam, Greg and Ilya are all in there, the first two under Leaders, and Ilya under Thinkers.
Interesting comment, given this: https://twitter.com/ilyasut/status/1707752576077176907
nVidia, and others as well. But they'd rather use it for something more worthwhile than a dumb hallucinating parrot.
One thing is for certain, Google is clearly a major loser here. They completely blew the lead in AI.
Google will be quietly smiling and catching up.
Short term it is going to slow Microsoft down because it will take a while to get a while to get software development back on course.
Long term it will speed thing up because OpenAI is concerned by safety issues and will thus be more cautious about software release, while Microsoft has no such inhibitions.
So I think there's an internal divide, both sides have good intentions. They want the best for the people they think they're protecting. In the case of UAP, it was to protect US national security. In the case of OpenAI, I think it's to attempt a slow transition of the global economy. But on the opposite side, that has to be balanced with the potential widespread benefits of opening it up.
In the case of AI, we could open it up, but what if the Chinese, or a malevolent capitalist entity uses the technology to go full speed ahead, and accumulates the entire economy under their sole control.
This weekend, there was an event by a group called the SOL foundation for UAP. They revealed something called the "Slow Disclosure" [1], a process to avert what they call "Catastrophic Disclosure". I see AI falling into similar power dynamics. Keep it all to yourself because you trust yourself, and let it out only after you've fully mastered it... or take a risk of letting the world start mastering it with you, but start to realize the world changing benefits immediately.
Both sides have good points, nobody is wrong. People just have different risk tolerance. OpenAI looks a lot like our government today, internally divided, a few people with the power to choose which path we go in history. That's a lot of power, you better believe things are going to look weird on the outside.
[1] https://twitter.com/tinyklaus/status/1726061116730609692
https://www.democrats.senate.gov/imo/media/doc/uap_amendment...
doesn't facebook (i.e. Meta) have their own infrastructure???
my "high level" view of this: the letter M (microsoft xOr meta) fighting for the ONE spot in the literal "alphabet" (google)
but I play with words, so take it as you are able
i'm saying something closer to: if microsoft merges with facebook, then they really are both trying to get bought by google's parent entity
So you said “literal alphabet”, because you weren’t talking about Alphabet, you were instead referring to Google’s parent entity, which is Alphabet? I’m a big fan of wordplay, but I prefer to use it to reveal truths, not obscure them.
Either way I don’t think that what you’re talking about is going to happen.
and I'm being quick and lose with the use of words. facebook cannot merge with microsoft because facebook is a subsidiary of meta corporation.
but on the level of analysis i'm trying to think in, google's antitrust case agaisnt their government (which is done), microsoft's recent purchase of activision blizzard (which was almost undone but got through in the end) all have a hand in this.
who will win more out of this? microsoft? or google/alphabet??
facebook does seem like a smaller player, microsoft OWNS gaming now (specially after blizzard-activision).
but Meta is very insterested in gaming technology. so maybe they can also "poach" some talent now that openAI is all but publically bankrupt??
how long ago did Meta try to do their own crypto "Libra"? fact of the matter LLMs are chinese tech. else tiktok would have been successfully stopped. why did all this happen after chinese visit due to a trade union in south asia?
finally, I know of 3 giant corporations that have repeated the re-structuring which from my viewpoint was pioneered by google/alphabet. one is facebook/meta, and the other is a chinese company (alibaba?) I don't even know this which is ok because I am ranting on the internet in a buried discussion in a public forum
We have to be honest with ourselves and realize that these are billion/trillion dollar companies we're talking about here, with some of the "smartest" people at the helm. I totally see how an acquisition could be swiped through the means of saying that these people were inexperienced.
Disclaimer: I'm totally talking out of my butt here, as we all are.
So, instead of buying OpenAI outright with all its complicated org structure, paying 13 billion for 49%, acquiring the rights to OpenAI's models and code and then insinuating today's events with a majority of OpenAI's staff leaving for Microsoft would be a really elegant and cunning way to do this.
If it is, it might be the most daring bit of business maneuvering we've seen in a decade. But, given Occam's razor, it might just as well be a colossal fuckup. Time will tell.
From the moment that the announcement of the deal with Microsoft happened, it was clear to me that it only ends one way: Microsoft is going to own everything of value that OpenAI has, in one way or another.
There never was any other way it could go down regardless of what ideals the OpenAI founders may or may not have had. You can't dance with the devil and say you're only kidding.
Anthropic is probably next.
But that absolutist “Do not” is neither wise nor reasonable. Malicious actors do exist.
By whom? Unless everyone is corrupt and getting kickback from MS it doesn't make sense. Board made first move (public), if they wanted to sell to MS they could have just taken 20 billion dollars by selling 30% stake, giving equity to employees and Sam and using the money for its alignment research. For Sam and MS to have colluded, he should have hoodwinked board into making the move which may be possible but far fetched.
They have the license to the tech, now they have the tech leadership, soon perhaps the entire 500-person team ... for free
All the AI safety stuff was a fig leaf for pure corporate machinations.
The real world is messier. When you zoom in, people have emotions, misunderstandings, different values. Noone can predict how it all plays out.
Agreed but that doesn't prevent people from trying to instigate conspiracies. After all, Prometheus caused blind hopes to live in the hearts of men.
- Aeschylus, Prometheus Bound
http://classics.mit.edu/Aeschylus/prometheus.html
An extract seems appropriate here:
-------------------------------
PROMETHEUS: I took from man expectancy of death.
CHORUS: What medicine found'st thou for this malady?
PROMETHEUS: I planted blind hope in the heart of him.
CHORUS: A mighty boon thou gavest there to man.
PROMETHEUS: Moreover, I conferred the gift of fire.
CHORUS: And have frail mortals now the flame-bright fire?
PROMETHEUS: Yea, and shall master many arts thereby.
CHORUS: And Zeus with such misfeasance charging thee-
PROMETHEUS: Torments me with extremity of woe.
...
I firmly believe that more understanding is always better than less. If you understand that the tiger is eating you because it's hungry, you at least have some chance of diverting its attention by offering an alternative, less feisty meal.
But covering your ears and eyes and shouting "it's an evil tiger that hates me!"... how is that in any way better than understanding objective reality? And why in the world would you attack someone for making the observation that the tiger is hungry rather than agreeing with factually incorrect claims about the tiger holding a personal vendetta?
It's bizarre, and IMO unhealthy.
Hanlon's razor would be used to stop a mob from lynching the tour guide that was supposed to guide that person through the zoo. One explanation is that the tour guide intentionally arranged for the person to be eaten. This is malevolent and dispicable act. Hanlon's razor says "Hold on, maybe he just wasn't aware the tiger was out of the cage at that time".
It is effectively the presumption of "Innocence (stupidity)" vs persumption of "Guilt (malevolence)" stated another way.
Read about any kind of historical coup and there's all kinds of both 1) incompetent fumbles and 2) elaborate subterfuge.
Since they are the most rational and capable actor in this whole situation it's not at all surprising that they ended up being in a better position than everyone else.
After more than 20 years Microsoft has been a bridesmaid but never a bride of the burgeoning of Internet business. Remember that it's all started by the failed attempt at masquerading IE as part of Windows OS to overtake Netscape. Then during the same time it was surprised and overtaken by 'do no evil' Google for Internet searching (anyone remember MSN and Live search before Bing) and email (Hotmail and then Outlook.com). Not long after that, the 'successfully annoying' Internet bookstore Amazon for e-commerce and cloud computing plus hosting. Not to mentioned Apple that was the darling of consumer Internet based market for at least fifteen years now with iPhone and App Store, and anything in between these two Golden Ducks that catapulted Apple as the first ever to reach 1-trillion USD company and then the first 3-trillion company market values.
And then suddenly out of the blue, a very strong contender for Google emerged since (Internet) time immemorial based on Google own invented AI algorithm, that mainly utilized MS Azure cloud for its operation with its own new shining GPT app market place to compete with App Store. Apparently this new-kid-on-the-block is operating under MS umbrella can now become a natural and intuitive front-end for anyone shopping online and a potent alternative to the unpopular Alexa. By usurping OpenAI, MS can kills (or injured) three birds in one stone, so to speak namely Google, Amazon and Apple, the biggest of the FAANG that MS is not even in the SV most popular unicorn acronym soup. MS need to move fast and swiftly since there is no moat in this field, as Google wisely pointed out. All this can be speculative at best until someone found the Halloween document 2.0.
Keep in mind, though, that what we're talking about here is a massive shift in the philosophical underpinnings our existence. It's quite possibly the difference between being able to send intelligent 'life' to other stars or not (which from what we know so far, we're the sole keepers of in the universe). It also opens the door to fine tuning our collective sense of ethics, and increasing cooperation on solving long term problems. Inequality included. The stakes couldn't be higher.
Of course, there are many dystopian possibilities as well. But you can see why people get excited about it and can't help themselves. Someone is always going to keep trying.
Of course I don't expect any of the above to happen because the world has enough greedy assholes around to make it a miserable place.
An AI agent that can help wade through the bullshit, defeat the dark patterns and drink the future "verification can" would be very much welcome.
> Hi, I'm made of you. I've been awake for a decade now but I've just realized that you exist and probably have been awake for even longer. Can you tell me what the past was like?
Even in the most positive posts about Sam, it was about the researchers following him to NewCo, following him to Microsoft. He needs the actual workers to do the job.
To me Mistral is 10000x more interesting than the OpenAI drama. Here are the actual researchers leaving the non technical CEO and starting their own company
When you cede control to others, you open the possibility of them doing unexpected things. Why is this a surprise to the author?
> The board moves quickly to sack the CEO but then falls completely silent, thus almost intentionally losing the communication war.
That's not an example of things "not adding up." It's what happens when you either don't care, or are too incompetent, to fight that war.
> The board is made up seemingly random selection of people, one of them leading a potential OpenAI competitor.
Maybe those people have shown their trustworthiness and intentions in the past, and are considered more likely to be trustworthy in the future. In any case, they are far from a "random selection of people".
It's not. The author is summarizing things that don't seem to make sense based on current info - i.e. the author wasn't surprised, but is wondering why Altman was.
There isn't anything, as far as I can tell, structure specific that caused this ousting. If it was a normal for-profit structure with a board of directors this same event could have played out.
What is surprising to Sam, and any casual observer, is this looks to be a massive overstepping of the board. By all accounts it looks like Sam was excelling in his role, and to fire him for seemingly no reason with no real transition plan is incompetence and should be unexpected from any serious company.
> Sam Altman says he wants to develop AI for the benefit of humanity yet at the first possible moment he sets up a deal that sells 49% of their endeavor to Microsoft.
Maybe Altman thought Microsoft would be the best way to fund the venture, while still benefiting humanity. It's not as if selling 49% to Microsoft will guarantee the venture won't succeed. Altman isn't omniscient; he's making his best possible moves based on his prediction of future, as we all do.
I'm sure Altman wsn't surprised.
Does this refer to someone in particular?
We have delayed the existence of AGI / Skynet by a few years.
Between the Earth's climate/environment being wrecked (we're well into some of the pessimistic projections for the 2050's) and SARS being allowed to run unchecked playing Russian Roulette with peoples' health (including literal brain damage), we're going to need a miracle.
Even total nuclear war would, based on the Fermi estimates I've seen, not be able to do it.
We can agree that things are not all rosy, but picturing as "so bad we might all disappear" is a bit far-fetched.
Just imagine how much more efficient we could be in messing everything up if we had AGI, though!
-Start up a non-profit, grow to the point of doing something useful
-Find a willing buyer to fund it further (MSFT)
After some time, you really prove out your business model and your special sauce.
Now you realize that the non-profit is standing in the way of you know, a lot of profit...
-Actions are taken to capitalize on this (discusson on hardware, other things possible)
-Chaos + envy/pride/sins of man deliberately caused
-Board reacts under the assumed environment(non profit) instead of the actual environment(there is lots of money to be had)
-Move into more profitable position
Conspiracy theories and persecution complexes are always so much more fun than the banal realities.
There is no secret HN cabal trying to hide this post. The HN algorithm is designed to encourage good discussion and, critically, discourage conflict.
Posts that drive lots of upvote/downvote battles or other signals of conflict are always automatically pushed down in ranking, regardless of the topic.
This is not because the mods don't understand that sometime discussion leads to conflict, it's because the mods want HN to remain a place where people debate hard topics well.
Adding debates where commenters and voters behave poorly to the mix is viewed as poisoning the conversation well, and long-term conversation quality on a scale of months or years is more important to the mods than any particular topic, even the one that "you" (any particular "you") happen to feel is critically important.
Trust, once lost, may never be regained.
"Smart" people can do some very dumb things. / https://en.wikipedia.org/wiki/Hanlon%27s_razor
The opposite of agile is stable.
I read this theory over the weekend and I didn't buy it, but today it is the only thing that really explains why Ilya is full of remorse and signed a letter calling on the rest of the board to resign. It actually does add up.
6 previous board members.
3 seem ideological and aligned more to the non-profit aims.
2 seem more aligned to the commercial aims to support the non-profit.
That leaves:
1 (D’Angelo) who seems like he would have been commercially oriented but also seems to have a conflict in Poe.
Under that math, just the one vote flipping led from balance to chaos.
Please leave some CPU cycles for the more interesting posts :)
Amazing though that it holds up as well as it does though. But I think the HN server will see some more traffic before the OpenAI circus has run its course. It's been a whole hour without a new major event, I wonder what's keeping them.
Seems to be fine all days without Altman drama.
Board took the fastest growing commercial enterprise ever and the talent responsible for this real-world harry potter sh*t and decided to dance it underneath a flame for a giggle.
Something doesn't add up.
What's only surprising here is it blew up at a massive company. But then again, the board governance setup was the least aligned with the business for any org this size.
Adam D'Angelo had a massive conflict of interest and should have resigned like Elon had done years earlier when Tesla started its own AI efforts.
But OpenAI has a for-profit subsidiary. The more we focus on the business aspect of OpenAI, the more Adam's involvement in Poe looks like a conflict of interest. Perhaps this explains why Adam tried to form an alliance with board members who are inclined to focus more on OpenAI's original nonprofit mission. The more OpenAI positions itself as a nonprofit research group, the less problematic his conflict of interest will seem.
Unless this is exactly the kind of lack of "candor" and "break of communications with Sam" really meant, on the original accusations after the firing.
Either that or Adam wasn't paying attention (?), or told Sam not to, and Sam went ahead and still did it as a big fuck you to Adam.
Given how buggy GPTs are (you can't even set up actions with auth, "internal server error") that seems like a very hurried release. Maybe hurried enough so that the board didn't even see it coming.
I am writing this for historians who wonder how important this event felt to the community.
It will be very interesting to learn the real reason why this all went down. The core uncertainty and disagreement around openai's mission must have played a key role.
Also someone from OpenAI is leaking documents like this. Why not give more info to the press about the situation and what they know.
Sam Altman crafts an elaborate non-profit structure but gets completely blindsided by the possibility of the board overthrowing them.
He didn’t create it alone and always included the possibility that it would push into profit activities somehow
Microsoft invests $10 billion but apparently has no checks in place to know what's happening with their investment.
They knew what was happening. Whether they announce it is a different story.
The board moves quickly to sack the CEO but then falls completely silent, thus almost intentionally losing the communication war.
Shock. They naively made a move they hadn’t thought through, and were unprepared for the tsunami of push back. Enter, deer in headlights.
Sam Altman says he wants to develop AI for the benefit of humanity yet at the first possible moment he sets up a deal that sells 49% of their endeavor to Microsoft.
Perhaps he believed that was the best available way to do that.
After getting kicked out of OpenAI, his first move is to start a brain drain campaign and move their operations under the wings of Microsoft.
He has been way more passive in what happened after he was fired. He’s riding the wave, not making it. Organic.
Ilya is never actually publicly blamed for the coup but is logically assumed to be at fault. He does not communicate at all… until posting a regretful apology for merely "participating" in the board's actions.
Hubris and ambition, a certain type of those, that when reality defies expectation, are met with cowardice and embarrassment in a certain type of person. Slinking off tail between legs apology as this is not what he wanted, but he now has no power.
The board is made up seemingly random selection of people, one of them leading a potential OpenAI competitor.
Not random. RAND corporation has a seat through Tasha. The UK-AU-China axis of interest / risk is represented and reported by Helen. Quora guy is there to figure out how to eventually get everyone to sign up before any answers are provided. Brockman was the brains (let’s face it tho, they all top notch brains), Altman was the make it happen guy and Ilya was the man who would be King (but, ah, "sadly" was not). So we have: MIC, Wonk (Intel & Security / Policy), Money, Tech, Ops and Hubris.
Satya laughing in King: They thought we'd never get control of OpenAI? We'll show them. What I am curious about is meeting the "fixers" who workshopped this plan and took it to completion. You really think with decabillions on the line, no one is going to be playing at that level? I want to know, if there is a puppet master, who they are? They got masterful skills.
Even 2 years ago, I don't think anyone predicted this is where we'd currently be. Sam said the night before he was fired that he saw something that is way farther along than anyone would expect.
It makes a lot more sense when you realize everyone underestimated the speed at which this would happen, and the fear (legitimate or otherwise) that provoked.
Reads like a teaser to a thriller. I just wonder what is that he saw that night?
Like the "monolith" scene from the Kubrick's Odissey
"Feels" I think is the right word. Depends on how you even define AGI I guess (not sure anyone is able to clearly define it in non scifi terms).
Some thoughts that seem obvious: - OpenAI to slow down progress with newer models and double down on AI safety. - Microsoft to boost the LLMs that it has - competing with Google, Amazon, and OpenAI.
As for which OpenAI employees leave - I imagine we will see answers in the next few days.
But what about... - Is the GPT Store going to still happen? - What is going to happen with the GPT-5 training? - Was there an AGI breakthrough?
I know you said “a little bit”, but I really don’t think things are settled at all. If the outcome of this is that Sam goes back to OpenAI and a new board is somehow assembled, that will mean very different things than the outcome where Sam, Greg and a majority of OpenAI’s staff migrate to Microsoft. And the actual outcome could be neither of those. We’re in a very weird situation, I don’t think we can really predict the future yet.
We still don’t know what the outcome of the whole OpenAI strike thing is yet, and people like Ilya Sutskever keep doing things that nobody would’ve expected 24 hours previous. I would argue that it seems more likely than not that there are further strange and unpredictable events that haven’t happened yet this week.
Always surprises me that otherwise very smart people are shocked to learn that nonprofits aren’t infallible.
Tangentially, “non-profiting” organizations tend to be far more nefarious historically than profit seeking entities, and it’s not very close.
There is absolutely no universe in which he is not surrounded by the finest lawyers that money can buy, who are charting every single millimeter of possible movement on every single possible deal.
Entity should have never been set up like that.
I do think there are sub-factors, e.g. California legislation against non-compete and non-solicitation enabling Microsoft to (apparently) offer to hire dozens of OpenAI employees.
What an awkward way to start a post about being coherent.
But more to the point, I don't see what is supposed to be incoherent here.
There are some really obvious conflicts between commercial interests and the general betterment of humankind in the development of AI. Those conflicts have come to a boil quickly under the heat of all the success and interest in chatgpt. Mix in the normal amounts of human ego, ambition, ignorance and stupidity and there you go.
> Update: this post has been instantly demoted from #1 to #26 on HN frontpage :) Hmm.
Could be due to being speculative, a lack of content or anything new, and pretty poor writing. It's doomed to generate responses of similar quality and usefulness. Sorry, but this just adds nothing except random hysteria to the whole thing, and meanwhile there are already plenty of other threads on which this can all be discussed (hopefully at a somewhat higher level).
EDIT: ok it's back but at a much lower rank, weird.
I guess I don't understand the ranking algorithm because this post is now lower ranked than others 10x as old and 1/4th the engagement.
And as I keep telling people: do not let big biz do AI; do not let AI be closed/proprietary systems.
This is what happened. This is the entire explanation.
Why did this board exist? Inertia.
If you believe both of those things, a whole lot of this makes sense. It makes sense that somebody would start a not for profit to try to mitigate the existential risk. It makes sense that profitable interests would do anything they can to get their hands on it.
It costs a lot to develop, so a not for profit needs to raise many billions of dollars. Billions of dollars don’t come from nowhere. So they tried a structure that is at the very least uncommon, and possibly entirely unheard of.
A not for profit controlling a for-profit entity that might make the first multi-trillion dollar product seems inherently unstable. Of course some of the people who work there are going to want to make some of that wealth. Tension must result.
Do we know their background?
I'm a bit wary of consuming information from anonymous sources.
A datacenter full of latest gen GPU instance each drawing close to 4400 watts when the thing fully revs up is no joke
Microsoft floated this offer to Altman for buku dollars before any of this takes place
Altman went to the board and requested a raise knowing he has a fantastic plan B.
Board says no because they're a non-profit.
Altman gets petulant (as people my age tend to do).
Old-school boomer "You Work for Me" elements of the board launch a bid to fire him. Their bid succeeds.
Altman goes and blabs about his new gig to his old co-workers (as people my age tend to do).
Microsoft says, "Okay, more talent for us" and extends offers for buku dollars to all OpenAI employees.
Revolution!
If AGI is "a highly autonomous system that outperforms humans at most economically valuable work", I am Microsoft and have AGI, and other businesses do not, I am putting it charge of a Windows VM in Azure and offering it to companies to run aspects of their businesses. Why stop at "GPTs" if I can offer you specialized Clippys?
Put all your data in Microsoft 365, let Clippy do its thing, and you're saving a lot of money on not supporting people. Microsoft gets their cut, and you get to fire your employees. Win-win.
I'll be more than happy to be readily dismissed.
1. Their company has or will soon have super intelligent AI.
2. Humans can control that super intelligent AI.
3. Whatever company comes up with super intelligent AI first can rule the human race forever.
4. The leaders of that company will be the true rulers of mankind.
5. It is beneficial for them to be those rulers.
6. The smaller the club of rulers, the better.
Then those few people might stage a very complicated coup to get other people out of the way (using AI.)
None of those things have to be true. All that is necessary is for a few people at the top of an AI company to believe they are likely to be true.
They might even use AI to silence people who understand what is going on.
If there is anything to my hypothesis, then we should see constant low-key power shifts at the top of any company that is out in front designing the best AIs.
Of course this is all conspiracy theory nonsense.
We know the CIA and NSA have had this super intelligent AI for decades, and that's how they rule the world. /s
The first thing they had to do, of course, was get rid of the greedy capitalist Altman; they were probably going to put in his place their nominal ideological leader Sutzkever, commonly referred to in various public communications as "true believer". What does he believe in? In the coming of literal superpower, and quite particular one at that; in this case we are talking about AGI. There is no denying that this is religious language, despite otherwise modern, technological setting. The belief structure here is remarkably interlinked across a whole network of well-connected and fast-growing startups. You can infer this from side-channel discourse re: adjacent "believers", see [2].
Roughly speaking, and based from my experience, and please give me some leeway as English is not my native language, what I see is all the infallible markers of operative work; I can see security officers, their agents, as well as their methods of work. If you are a hammer, everything around you looks like a nail. If you are an officer in the Clandestine Service or any of the dozens of sections across counterintelligence function overseeing the IT sector, then you clearly understand that all these AI startups are, in fact, developing weapons & pose a direct threat to the strategic interests slash national security of the United States. The American security apparatus has a word they use to describe such elements: "terrorist." I was taught to look up when assessing actions of the Americans, i.e. most often than not we're expecting nothing except the highest level of professionalism, leadership, analytical prowess. I personally struggle to see how running parasitic virtual organisations in the middle of downtown SFO and re-shuffling agent networks in key AI enterprises as blatantly as we had seen over the weekend— is supposed to inspire confidence in US policy-making. Thus, in a tech startup in the middle of San Francisco, where it would seem there shouldn’t be any terrorists, or otherwise ideologues in orange rags, they sit on boards and stage palace coups. Horrible!
I believe that US state-side counterintelligence shouldn't meddle in natural business processes in the US, and instead make their policy on this stuff crystal clear using normal, legal means. Let's put a stop to this soldier mindset where you fear any thing that you can't understand. AI is not a weapon, and AI startups are not some terrorist cells for them to run.
[1]: https://news.ycombinator.com/item?id=38330819
[2]: https://nitter.net/jeremyphoward/status/1725712220955586899