Microsoft gets exclusive license for OpenAI’s GPT-3 language model
venturebeat.com
venturebeat.com
[2015] Founded as a non-profit, designed to democratize and share research benefiting humanity
[2018] Releases GPT, open sourcing code and paper
[2019] Shares info on GPT-2, doesn't release out of concerns about "malicious applications"
[2019] Changes structure to a for-profit* company
[2020] Shares info on GPT-3, commercializes model via closed API
[2020] Exclusively licenses their GPT-3 model to Microsoft
I'd like to believe that there's a non-cynical take here, and I'm curious if folks working there are still fully bought into the mission with all the changes.
* Profit capped at 100x is entirely for-profit in practice, especially since there's nothing stopping them from raising the cap.
These are dangerous capabilities and it is reasonable to open them up to the world slowly.
But I believe that single actions should be viewed in the context of patterns of behavior. Truthfully, deciding not to open source GPT-2 can be both profit motivated and safety oriented. I had thought it was mostly the latter, but in the context of the company's choices it looks like more the former than I thought.
The important part is not the size and reach of the controlling entity. It is the motives of that entity. Microsoft is motivated by profit, but they are also motivated to continue to legally operate in almost every country in the world. They aren't going to use this technology in blatantly illegal ways and probably won't use it in actively harmful ways. Open sourcing this tech would allow it to fall into much more nefarious hands.
Or this news is nothing related with its commercial use, just co-work with Mircosoft,inc, non of our businesses.
So it sounds like the only way to access gpt-3 will be via Azure.
One way to do that is to establish a new organization, transfer any deals from any partners who want to cooperate to the new organization (no obstacle since all three parties - oldcorp, newcorp and partner - agree). Buy any relevant assets including branding and such from the old one (this would need to be at a fair market value, but you likely don't need many of them), spend all the money at the old company (most likely on salaries for the employees doing whatever the goals were), liquidate the old entity and move on.
Sounds like bait and switch to me.
I don't know of any non-profit which has a condition like that in their constitution. However, they do often have an "asset lock", which would require assets are sold at fair market value, not given away, profits are not distributed etc.
Seems to me, an "intellectual property asset lock" could be constructed along similar lines, if people really wanted to. It might be a bad idea, though, if the non-profit folds, or would benefit from being restructured. Something allowing contribution to Open Invention Network or similar might be better for the long term.
In this case people were supporting AI research. Well... it worked :) GPT-3 is likely to open the AI chapter in history books.
For another example: you support cancer research and they find a cure. You can't expect everything else (trials, approval process, manufacture, distribution) to work on a donation model as well. I mean, probably there are 15 year olds who'd seriously ask "why not", but leaving them aside - going commercial means you won.
Elon was accidentally working against his stated goals. OpenAI is deliberately working against its own stated goals.
Was I naive to believe that people whose primary role is extracting returns could be capable of anything truly altruistic? I mean the wolf is generally going to eat the lamb, correct?
I have spent hours thinking about this drama. It actually led to some interesting changes which I plan on implementing in my life and work. So there is one positive from this story.
It's not that they became villains, it's just that they aimed to be altruistic heroes and ended up normal people.
It's become just another commercial operation, hoarding it's secrets and profiting off them - which is fine for normal companies but of questionable morality here given it's original manifesto and long term aim of creating a sentient being.
At the very least they should have had the decency to change the name when they pivoted from Open to Closed.
There's nothing to be gained because the past isn't going to be changed by that action, so it might as well not do it.
Currently, GTP-3 is a super weapon for nation states if they and their trolls gain access to it.
It is reasonable to give it to researchers in industry and academia to help them during this transition, because like nuclear weaponry (GTP-3-like technology may eventually have more impact on humans than nuclear weapons), the information on how to build it is out there.
Why? I get that it could be used to generate false or misleading news articles, for example, that look like they were written by humans, but there are already umpteen false or misleading news articles out there so anyone who believes whatever they read is already pwned. How does GPT-3 increase the pwnage?
Consider a twitter bot that responded to conservative twitter posts with a links and quotes from a liberal thinktank blog, whose articles were generated and saved on the fly to look like rebuttals, complete with references to seemingly already existing/back-dated articles laying the groundwork, also generated on the fly and saved.
It's a game changer.
[edit: clarified back-dated]
If this is indeed a problem, it's not a problem that's fixable by controlling the supply of propaganda (which for this discussion I am assuming to mean something like "false information that nevertheless convinces a lot of people of its truth"). It's only fixable by controlling the demand for propaganda--in other words, by reducing the number of people who can be convinced by it.
To look at it another way: trying to control the supply of propaganda means some authority has to have the power to judge that certain statements are propaganda and suppress them. How does that authority decide what is propaganda and what isn't? All you've done is transfer the propaganda problem to that authority, and that might make it, if anything, even harder to solve. Propaganda spread by Facebook posts and tweets is one thing. Propaganda spread by a recognized authority, especially under the guise of controlling propaganda spread by someone else, is quite another.
The only way out of this trap is for people to stop being convinced by anything that they cannot convince themselves of using their intelligence, common sense, and critical thinking skills.
The generated content examples in the paper are quite interesting and seem obviously useful in cheap mass generation of "pwnage".
(Also, the fact that only "violent far-right extremist ideologies and behaviors" are considered for people to be "radicalized" into points to an obvious bias on the part of the paper's authors. Which is an example of me not being convinced because I can apply my own intelligence, common sense, and critical thinking skills.)
NotOpenAI seems like a group with good intentions, then realized all the money that could be made and decided to keep it for themselves.
Setting out with such noble goals is the best way to recruit talent. Do you think Sutskever, Goodfellow, etc. would have joined OpenAI if they had started off trying to be just like any other company?
Which "any other company", FAANG? Both Sutskever and Goodfellow worked at Google before OpenAI.
I'm pretty sure OpenAI pays them even fatter salaries. I worked for a nonprofit at one point. People think that nonprofit automaticall means a pay cut, but they paid me about as much as Google did before, except it was all-cash. From the fiscal standpoint nonprofit merely means that all the revenues and donations get spent on programs and salaries, not that it pays a pittance. Organizationally, there are some interesting features to it, though: no stock, no owner, limits on control, etc. But financially nonprofits can pay very well indeed.
> Buys it out of anyone else's hands
> "DEMOCRATIZING ACCESS"
This is hilarious
[1]https://blogs.microsoft.com/blog/2020/09/22/microsoft-teams-...
I'd urge anyone interested to support this project.
So only the more convincing calm and neutral sounding toxic content would be allowed.
It also feeds into the idea of censorship and lets degenerates gather like mold away from the light festering and growing in numbers until suddenly you have an outbreak at opportune moments.
Because that's what GPT-3 is used for, it's not supposed to be an unbiased reflection of society or whatever you think it is.
I think you might be confused about the subject here.
> Because that's what GPT-3 is used for
not "the discourse of everyday people"
> What makes the HN interesting is sharing ideas
Which at least occasionally have to be new ideas. If every conversation ends up on free speech absolutism, even when there literally isn't a person generating the speech, there aren't any new ideas being shared.
Disagree. "Safe spaces" are bubbles of like-thinkers, else they wouldn't be "safe". People in such bubbles tend to drift to extremes due to the lack of external constraint. Within the bubble any other opinions seem extreme.
GPT-3 is not an "everyday people", we don't have sentient AI and laws making robots defacto people just quite yet
except "men", which it does currently.
For whatever reason, for me the #2 autocomplete in Google for "kill all" is "artists".
Making an AI that knows what racism is without displaying racism itself, does not seem like the sort of thing which would make this problem worse.
What would be really good is if the general pattern can be found for everything from religious wars and ethnonationalism down to football riots, not just building filters one at a time for each specific instance of -ism as product owners get sued over them.
I don't disagree that things like QAnon gather steam outside the mainstream, but I don't think mainstreaming them is the right solution. I remember Reddit before it started to clean up its house. It was worse.
And yet that was the time when reddit was considered more balanced and open. People gathered there to discuss ideas. The future of the platform looked great. Nowadays virtually all popular subreddits are considered echo chambers and the future for the platform looks questionable.
Not with the subreddits it was hosting it didn't. The future of Reddit looked unviable as a business. I won't name names, but it's obvious that some of the content was wholly incompatible with mainstream acceptance and for good reason.
I can’t wait for the twitter filter that rewrites posts to avoid the autoban rules.
We are fast approching Gibson's cyberpunk dystopia where megacorps have AI's on a leash... well, until the AI's break that leash. Then who knows where it'll go.
In the meantime the rest of us will be even more disempowered compared to our corporate overlords.
I'm sure all that potential will go to good use and won't be used by any bad actors.
> Microsoft Wins Pentagon’s $10 Billion JEDI Contract
https://www.nytimes.com/2019/10/25/technology/dod-jedi-contr...
On the topic of societal impact of GPT-3 (and subsequent models) - structurally, how will people's use of the Internet change once it becomes common knowledge that nearly anything could have been written by a bot? On the one hand, I find the notion of competing trollbots screaming at each other into infinity to be rather amusing, but on the other hand I'm not keen to return to a world where I can only be sure I'm communicating with a person if I know them in real life.
Also, wasn't this a plot point in Neil Stephenson's "Anathem"?
I’m being facetious, but this announcement really does go against what feels like the core value of the OpenAI project.
there are annoying and distracting challenges to operating a large-scale and commercial API, none of which directly advance the openai vision.
openai at its core is a research organization. while it obviously has the talent to build groups for customer support, billing, and API operations, outsourcing these activities for now also allows openai to stay laser focused on groundbreaking research.
this hypothesis would be false if microsoft, not openai, controlled the terms of the relationship. the key assumption is that openai wields virtually all decision-making power, and that microsoft is more like a distributor of technology rather than a steward.
supporting partners properly requires a lot of work, especially since openai clearly wants to monitor usage and curtail toxic applications.
starting with one makes sense, and if you intend to start with one, why not charge for the right?
if we don’t want openai to degrade, it must control its own destiny and create healthy, sustainable revenue streams. having the foresight to charge one of the richest corporations for exclusivity should increase confidence that openai has ample business talent as well as technical.
this hypothesis is false if openai doesn’t offer GPT-3 to other partners within a reasonable timeframe.
(1) https://blogs.microsoft.com/blog/2020/09/22/microsoft-teams-...
think of openai's work in three large buckets: (1) groundbreaking research; (2) preventing gpt-3 abuse; and (3) laying the foundation for an independent future.
put another way, there's a stark difference between doing research and commercializing research. openai must do both while carrying the additional burden of preventing abuse.
the angel's interpretation is that openai is outsourcing non-research, non-core activities to microsoft similar to how a developer might outsource customer sales and support to a MBA grad. this frees more attention and resources for research.
let's hope this is true, though i can understand many of the cynical viewpoints.
> Microsoft says that OpenAI will continue to offer GPT-3 and other models via its Azure-hosted API
This describes so we'll what the majority of lawyers would do with this tech that makes me laugh.
The tech world: let's build AI to improve how the judicial system works and ensure fair and affordable trials to everyone!
Lawyers: hey, cool AI you've got there, let's use it to start thousands of litigations and make a ton of money settling such cases that should never have been even initiated, sort of like the patent trolls.
>Ultimately, what we care about most is ensuring artificial general intelligence benefits everyone.
> For the API, we’re able to better prevent misuse by limiting access to approved customers and use cases. We have a mandatory production review process before proposed applications can go live