We are discussing the possibility of severe adverse societal/world/human impacts from AI, why should open vs closed source/weights, copyright violations, anti-competitive moves, corporate hypocrisy, etc be so heavily weighted in the discussion? Hell, multiple things in OP’s list are quite literally moves a good-faith (wrt the topic at hand, genuine vs non-genuine concern) actor in such a position would do: closed weights means bad actors can’t abliterate, regulatory control, getting blacklisted by Hegseth’s DOW because they LIMITED acceptable use cases…
I’m not pro- or anti-Anthropic at all, but it has started to annoy me how biased and shaky reasoning gets about this topic on here, it feels like people arguing to fit their existing opinions into today’s hubbubery rather than measured analysis of said hubbubery, which is why I come here.
Question: consider the scenario where RSI is reached internally and internal tests struggle to align or control/contain the model; what are the differences in observables vs what we’re observing today?
We're literally trying to build something that's smarter than all humans and with the capacity to do extraordinary work while most people think there's no risk in open sourcing this capability with no guardrails (model ablation means no guardrails and as far as I'm aware can't be stopped).
Has our distrust in western companies really gotten to the point they'd rather unfiltered Astra level capabilities in the hands of every hostile government and terrorist organisation than potentially do any form of regulation in case it plays into the AI labs hands.
Ever checked political programs of Thiel, Musk and the rest of billionaires? They are literally and openly hostile to democracy, human rights, freedom and govermantal structures that made world more peaceful.
They are literally the hostile entities.
I'm far more concerned about every scammer having unfiltered frontier model access than the movements of our billionaire class.
And they have actual tangible successes.
Uncensored Chinese LLMs will be available to scammers forever now. They're open-weight and finetunable. You don't get to control that, and the self-serving billionaire assholes aren't capable of changing it either. They're only looking out for themselves.
This would be a good time to pull out a tool to measure "smarter" (intelligence). Unfortunately we don't seem to have one.
Some AI developers instead became the gatekeepers of something akin to "proper behavior in human language", which then morphed into "proper left-wing social/political behavior in Southern California in the early 2020s".
This is a task which calls to mind the old warning to "never wrestle with a pig: the pig enjoys it and you both get filthy".
IOW they have a scope problem. But the genii is long since out of the bottle. Effort ought to be on getting back to useful problems solving.
If they continue on their current path they risk becoming the greatest bureaucracy ever.
We're all dead!
Let’s be real, this is every single company. They care about open source as long as it’s “free to exploit”
Uh, no. They're against open weights. They benefited from open source. Not the same thing.
And the terms of those open-source licenses explicitly allowed usage of the code for whatever. They're using it exactly as licensed.
> Why do they get to benefit, but not everyone else?
How many tens of billions of dollars have you invested into training models?