Comment by ericmay | Hacker News Reader

Comment by ericmay | Hacker News Reader

Parent Full thread

> You're not advocating for it because it is highly immoral and illegal. That answers your question for the most part.

Well truthfully I’m not advocating for it because I don’t have any insight into these labs or the true capability of these models. But as a hypothetical if someone knew with 100% certainty that Big AI Button was being built and it would kill all humans or destroy all of humanity there is no moral ambiguity that anyone with the means to do so should stop that button from being built and kill everyone involved to save our species. This doesn’t apply to just AI though, but that’s the topic at hand.

> It's not exactly trivial to go from "I'm just doing my job" to "I need to kill everybody in my company to save the world" in a year or two, especially if a very, very large part of society doesn't even see the justification for it.

I agree with you, which is also why I think “omg I’m quitting they’re going to kill everyone” or other sort of sensationalized comments or news articles should be viewed skeptically - it’s probably fear mongering. Quitting your job here just seems pointless and attention seeking. Likely quit for some other reason.

What if you have 10-20% certainty the AI being built will kill everyone? Go on a rampage and land yourself in prison just so Lab B or China can win the arms race and their AI can kill everyone? Probably not. Quit your job? Sure.

What if you have a 70% certainty?

You don't have to go on a rampage in an American lab. If Chinese labs were ahead I'd bring about the same discussion.

Though separately if the United States (or China or anyone) believed one country or another was truly going to achieve something akin to a metaphorical AI Supremacy maybe you nuke them, or at least the labs/researchers. Many a sci-fi movie has been built on a similar "first strike" premise.

> But as a hypothetical if someone knew with 100% certainty [...]

This is an unreasonable demand. The quitting employee in this case said this:

"I am optimistic about the potential for coordination. Warning shots like the Hugging Face attack have made pacing agreements between U.S. labs more viable. I don’t feel like we’re on track to prevent a global race, which may require costly actions such as a temporary ban on improving model capabilities. If you are a lab researcher, I urge you to consider what the next few years will actually feel like. Do you want to kick off a superintelligent RL run without a rigorous understanding of its mind? Should you put your head down because “it’s happening anyway” - or take this moment to call for different conditions?"

You demand that he should kill multiple people rather than quit his job because he believes the above. This guy doesn't want to be part of the problem and may very well go on to advocate strongly against what's happening from outside Anthropic.

> I agree with you, which is also why I think “omg I’m quitting they’re going to kill everyone” or other sort of sensationalized comment

You didn't read what he wrote, did you? Because that sensationalized comment seems to have originated entirely in your head.

  > This is an unreasonable demand.

I'm not making a demand, I'm setting an anchor point from which we can work backward from. Is there any doubt that if someone was 100% certain that Big AI Button was being built and it would kill all humans that said person has a moral obligation to do everything they can to stop the button from being built and pressed?

  > "You demand that he should kill multiple people rather than quit his job because he believes the above. This guy doesn't want to be part of the problem and may very well go on to advocate strongly against what's happening from outside Anthropic."

Horse Shit. Here's what was written [1]:

  "The people building Al earnestly believe that it could kill us all by the end of the decade. This is not a marketing stunt."

> You didn't read what he wrote, did you? Because that sensationalized comment seems to have originated entirely in your head.

Look in the mirror.

[1] https://x.com/hilbertspaess/status/2097476203863224394

> if someone was 100% certain

This is unreasonable because nobody can know 100% certain that the AI built at Anthropic will kill everyone. It is also a big-ass strawman because the author never claimed he was 100% certain that AI will kill all humans. You're arguing from an irrelevant hypothetical (in which, I might add, most people would still not automatically change into murderous psychopaths as you apparently think is normal).

> Horse Shit. Here's what was written

It's a whole thread, my man. And nowhere does it say "omg I’m quitting they’re going to kill everyone". Read the entire thread again and then say with a straight face that the gist of it is "omg I’m quitting they’re going to kill everyone".

> This is unreasonable because nobody can know 100% certain that the AI built at Anthropic will kill everyone. It is also a big-ass strawman because the author never claimed he was 100% certain that AI will kill all humans.

Ok then stop arguing about my hypothetical if you don't want to engage with it. Those of us who are interested in talking about it can do so in peace without distracting comments.

> change into murderous psychopaths as you apparently think is normal

Please stop engaging in this hyperbole and go find some other axe to grind.

> It's a whole thread, my man.

I took a direct quote from the thread where earlier you accused me of pedaling in sensationalism and "not reading".

I'm not the one reacting to reasonable behavior with some edgy comment containing broken logic.

The author of the Twitter thread is not some egotistical attention seeker and never said "omg I’m quitting they’re going to kill everyone". His logic for quitting his job and not acting like a psychopath is sound. Yours is not.

I've already explained the matter to my satisfaction.

Reply on news.ycombinator.com