Hacker News Reader

Comment by armcat | Hacker News Reader

It's interesting that the default thinking is that no one on the planet can be trusted except a privileged few. Event Karpathy has gone this way: https://x.com/karpathy/status/2098811935114551617

You can always open source and follow the example from Linux and all the amazing things that came out of the open source community. This is the only way to reach true equilibrium globally, where for every misalignment you have equal and opposite effort working on the alignment.

View on HN

This only works for some technologies - those where everyone having access to it doesn't cause a tragedy of the commons. I love open source too and yet that doesn't make me like the idea of being murdered by a misaligned model. Nor, for that matter, of being infected by a bioweapon made by a different disgruntled open-source enjoyer, nor of living in a world where anyone can hack anyone.

At this point, you are more likely to be stabbed to death, gunned down, or mowed down with a car, by any random psycho. For the nasty or disgruntled actors, they are today able to build bombs or chemical weapons without the use of AI, they have proven this time and time again. Japanese PM Shinzo Abe was assassinated with a home made gun.

The US government murders all kinds of people and they will most certainly not be slowing down their model development (with the very companies trying to do regulatory capture here). You won't have access to a model that could defend you, "they" (government and trillionaires) will keep you at bay by force. That's the plan anyway, I don't think they can actually stop open model development.

Embedded evaluator will be a great side/consulting-gig for Karpathy and the likes. How do you think these people will be picked?

Would you argue the same for allowing everyone to have guns?

(1) Are guns open source? (2) Far more people - order of magnitude higher - have access to guns than they do to open source software - I count access as in actually being able to do something with it.

i would, i support the 2nd amendment.

the same logic applies well to the freedom to own and use ai.

empowering the people prevents tyranny.

such freedoms make society less safe. it is better to face the harms caused by a free public than to vest power in the elite, those like dario amodei.

the elite belief that they have a right to paternal rule makes them blind to their fallibility. no individual should have absolute power.

Reply on news.ycombinator.com