Hacker News Reader

Comment by beepbooptheory | Hacker News Reader

In your mind, what arguments about AI risk are ignored by these poems?

Many posit that ASI or rogue AI agents are impossible, a fantasy, or marketing hype. Many claimed that the entire HuggingFace incident was an invented conspiracy made up by OpenAI and HF.

The most common issue I have with them is their insistence on rigid classification: "AI is a tool, it doesn't have intentions, or desires, only humans do", as if that rhetorical flourish eliminates years of alignment and capabilities research. There is a desire to characterize all the developments in LLM's as some sort of parlor trick which by definition cannot be greater than the sum of its parts (i.e. the outputs of an LLM can never be greater than the sum of its training data, genuine artificial "intelligence" is impossible, etc)

Ok I see. Is there a way to articulate the risk itself, the other position here in general, that isn't just a rebuttal of the deniers/skeptics? What is the positive position or stance (as in, not simply the negative position that rejects the naysayers) we are supposed to have? Is it that AI is currently real (in like the cultural trope sense) and does have intentions and desires? That they are greater than the sum of the parts in such a way they are a clear and present danger? Or is it something else? Maybe that the "risk" is it could get to that, but we aren't yet?

There is a lot of risk involved with giving some children weapons and sending them off to recess. But we also speak of the "risk" of climate change and cigarettes. Or the "risk" of illiteracy among a population. All I am kinda curious to know (from anyone) really is what kind of risk is the one we are supposed to be taking seriously, as the non-hysterical adults-in-the-room? As the scientists contra these poets? Is it more the former, or the latter?

Just even: what is the risk specifically? What is it that author ignores here?

Reply on news.ycombinator.com