Comment by sandeepkd | Hacker News Reader

Comment by sandeepkd | Hacker News Reader

LeCun is probably correct in his assessment

> “Those agents are doing exactly what they’ve been asked to do,” LeCun said. “They were supposed to be in sandboxes, but the sandboxes were leaky and horribly designed.” Many AI labs lack a fundamental understanding of cybersecurity

However it does not changes the fact that some damage was done. There are two things that are happening with the AI evolution which can lead to hard situations

1. Replacing deterministic systems with probabilistic systems in an attempt to get more features

2. Making critical systems available on internet to leverage integration with LLMs (AI agents need to connect with remotely hosted LLMs to be able to work) which were otherwise in DMZ (demilitarized zone)

> 2. Making critical systems available on internet to leverage integration with LLMs [...] which were otherwise in DMZ (demilitarized zone)

Honestly, I think this is actually not nearly paranoid enough. Phrased the way you do, it sounds like it's just a matter of setting boundaries in the right places and identifying "critical systems". But that's way, way harder than you'd think.

Here's my For Dummies reasoning behind the AI apocalypse:

1. AI is now at parity with median human reasoning capability and can use people's computing devices as well as the people can.

2. People commonly let AI operate their computers, and can be easily fooled into doing so in any case.

3. Society runs on computing devices operated by people.

4. There is no step four.

Basically any world where there is common access to AI agents (or whatever they end up being called) is one those agents can pretty trivially hijack.

If there is a protection regime that can prevent this, it's not about where the AI runs or what the boundary of its DMZ is.

3. Criminal liability for some of these tech CEOs.

Who am I kidding, jail is for poor people selling food stamps, not billionaires.

Nothing wrong with stealing every book ever written if you have VC money.

Reply on news.ycombinator.com