Is everyone now believing that AGI is within reach? This scrambling to have a non profit based structure is odd to me. They clearly want to be a for profit company, is this the threat of Elon talking?
We had what I, personally, would count as a "general-purpose AI" already with the original release of ChatGPT… but that made me realise that "generality" is a continuum not a boolean, as it definitely became more general-purpose with multiple modalities, sound and vision not just text, being added. And it's still not "done" yet: while it's more general across academic fields than any human, there's still plenty that most humans can do easily that these models can't — and not just counting letters, until recently they also couldn't (control a hand to) tie shoelaces*.
There's also the question of "what even is intelligence?", where for some questions it just matters what the capabilities are, and for other questions it matters how well it can learn from limited examples: where you have lots of examples, ChatGPT-type models can be economically transformative**; where you don't, the same models *really suck*.
(I've also seen loads of arguments about how much "artificial" counts, but this is more about if the origin of the training data makes them fundamentally unethical for copyright reasons).
* 2024, September 12, uses both transformer and diffusion models: https://deepmind.google/discover/blog/advances-in-robot-dext...
** the original OpenAI definition of AGI: "by which we mean highly autonomous systems that outperform humans at most economically valuable work" — found on https://openai.com/charter/ at time of writing
I did work around this last year and there was no limit to how smart you could get a swarm of agents using different base models at the bottom end. This at the time was a completely open question. It's still the case that no one has build an interactive system that _really_ scales - even the startups and off the record conversations I've had with people in these companies say that they are still using python across a single data center.
AGI is now no longer a dream but a question of if we want to:
1). Start building nuclear power plants like it's 1950 and keep going like it's Fallout.
2). Wait and hope that Moore's law keeps applying to GPUs until the cost of something like o3 drops to something affordable, in both dollar terms and watts.
Nuclear has a (much) higher levelized cost of energy than solar and wind (even if you include a few hours of battery storage) in many or most parts of the world.
Nuclear has been stagnant for ~two decades. The world has about the same installed nuclear capacity in 2024 as it had in 2004. Not in percent (i.e. “market share”) but in absolute numbers.
If you want energy generation cheap and fast, invest in renewables.
I don’t think blackouts are very common for grid connected data centers :)?
Wind is strong at night when solar produces nothing. Same in the winter months.
As I said: if the power consumer is grid connected, this does not matter. Example: I have power in the socket even at night time :)
As long as you have uninterrupted power (i.e. as long as connected to the grid), the important metric is mean cost of energy, not capacity factor of the production plant.
For a nuclear sub or a space ship, which is not grid connected, capacity factor is very important. But data centers are usually grid connected.
> when data enters need power all day every day nuclear is the only solution
Do you think data centers running at night are running exclusively on nuclear-generated power :)?
We already have lots of data centers that need power all day every day. Most are just grid connected. It works.
Especially if it takes so much compute to do any one task.
Sounds legit.
It's not that the remainder want nonprofit ownership, it's that they can't legally just jettison it, they need a story how altering the deal is good actually.
To extrapolate, (of LLMs and GenAI) the more I see use of and how it's used the more it shows severe upwards limits, even though the introduction of those tools has been phenomenal.
On business side, OpenAI lost key personnel and seemingly the plot as well.
I think we've all been drinking a bit too much on the hype of it all. It'll al;l settle down into wonderful set of (new) tools, but not on AGI. Few more (AI) winters down the road, maybe..