OpenAI ignored the ‘have a problem to solve’ rule, says president Greg Brockman
fortune.com
fortune.com
It's a large an ambitious problem but they pulled it off.
If they didn't target any problem, will OpenAI continue to be worth $30 billion if/when LLMs become as accessible as, say, relational databases?
Get in early, be best-in-class for the important part of the development cycle and make it hard to switch.
As do most of us.
I will accept my billion-dollar valuation now. Thanks.
OpenAI is just the first case where this is so good it's viable and lo and behold it took off like fire.
That is a well defined established problem that anyone paying attention said there was money in.
I was trying to get seq2seq networks to take english and generate API calls all the way back in 2016.
I was also an evaluator for Google Ventures, which meant I'd go look at all the details in a startup and decide if it made sense to invest. I've seen many companies with similar splashy hype who failed to reach orbit.
Really? Because I don't think I can think of a single company in the last decade that has achieved this level of hype. Maybe Tesla.
Those are interesting problems, though, like where it doesn't seem like it's a problem at first, but then you find the solution, and then you're like... holy moly, how did I ever manage? The hidden problems.
This feels like a stretch considering the massive investments they've received.
Massive investments = massive growth expectations
Given the computer power required behind ChatGPT isn't that unlikely at this point? Aren't they one of the few games in town with both the software and required hardware?
Some problems are likely to be too big for AGI to solve, many others would be bottlenecked by the same thing that bottlenecks human intelligence - real world evidence/experimentation.
The idea that somehow the right answer is hidden in preexisting data and that a sufficiently complex algorithm would be able to find it is amusing and quit likely wrong.
Also there’s a fantastic BBC docuseries called “Connections” by James Burke that makes the case that nothing in tech could have happened sooner or later than it did, and that each progression was an inevitable next step from the previous. It has interesting implications.
I just thought the parallel was particularly insidious in the context of AI.
To GP's point, the idea of technology evolving for its own end is thought provoking and perhaps a little scary /because/ it does have historical basis, if for no other reason than for war, the ongoing constant of historical life. I guess it's most thought provoking to me because I want deeply to believe in the enlightenment, which seems diametrically opposed to the idea of technology evolving for its own end. But it's hard to convince myself of the realism of intrinsic technoprogressivism. It seems to me that progressivism in technological development must be very deliberately crafted and diplomatically achieved through global pacts between many nations and the will of their people.
It's not as much technology developing for its own ends, but rather things happening when conditions are ripe.
I haven't studied the period well enough to have a strong opinion here, but my current feeling is that enlightenment became inevitable once the printing press spread around the world - giving many more people access to knowledge and opinions, allowing many more people to broadcast their views, and do it much faster and more thoroughly than secular and religious establishment could ever hope to suppress.
This isn't to take away the achievement of individuals coming up with ideas we now consider important - it's more of a recognition that those ideas are products of their times, that there were people in the past with the same ideas, but they didn't spread because conditions weren't right.
This is a similar take to explaining why scientific breakthroughs were usually made by many people, independently, at roughly the same time: that's because the limiting factor of progress isn't individual genius, but the conditions - existing scientific body work, economics, technology for testing and measuring. Once conditions are right to enable the next incremental step, it pretty much immediately gets made by multiple geniuses around the world.
I suppose this is half of the truth. The way I see it, it's a feedback loop: people develop technology for reasons, technology ends up transforming societies well beyond predictions or intentions of the inventors, which leads to new problems requiring new technologies, ... rinse repeat.
My current belief is that something I heard labeled as "technological determinism" holds at the high level: culture is primarily driven by economic incentives, like water flowing down and around a landscape; development of technology is one of the primary ways this landscape changes. Technology and economics are in tight feedback loop. Culture just follows, perhaps occasionally influencing the economics/technology feedback loop.
I'm not holding that belief strongly. It's just that so far, I've seen plenty of evidence for it - i.e. social transformations that were inevitable given the economical and technological landscape, and human nature - while I can't think of a single case of social progress that was independent of the economics, and solely conditioned on critical mass of people making an ethics-driven decision.
If you have oodles of money from the wealthiest people on the planet to spend on the worlds best researchers, you too can ignore this rule.
You can check for yourself though: https://research.facebook.com/people/research-area/augmented...
Going through that list regardless, I don't find Carmac there, and searching about it, seems he quit ~5 months ago. Might want to dig up a better example :)
And if you don't think one of the richest companies in the world can afford to hire whoever they want, then you're just being intentionally obtuse.
It's not that I believe they couldn't afford worlds best researchers, mostly questioning that the worlds best researchers would want to work at Facebook, no matter what the pay is.
If you don't think Meta will release Horizon on Apple's headset, then you havn't been watching.
Meta has admitted to pivoting to AI and cutting down their metaverse teams significantly.
Besides, even if Apple succeed. Meta will still be stuck in the exact same situation - under Apple's boots again, which it so desperately tried to escape from by going hardware heavy in VR in the first place.
Or are you talking about the grifter-laden crypto/NFT-adjacent "metaverses"?
Or are you talking about the ridiculously successful Second Life, Roblox, or MMORPGs like World of Warcraft?
Despite that, video games and persistent virtual worlds have thrived.
Metaverse isn't solely defined by Facebook's "Horizon Worlds".
"The metaverse is a virtual reality (VR) space that enables users to interact with each other inside a computer-generated environment."
Maybe you're unaware of what the Metaverse is, and you're projecting some imagined reality 5-10 years down the road where the "Metaverse" is just web6 or web8 in terms of VR/AR integration with the internet as a whole. In that sense, yes, everyone with a foot in the game will have adopted to whatever that future looks like, but the Metaverse as we know it today will still not have been a success.
I think Microsoft is even ahead of Facebook in terms of a "Metaverse" style UI integration 10+ years ago.
You cannot just throw reams of cash at something and expect it to be a hit.