Hacker News Reader

> Jail-broken Fable level LLMs can mean constant hacking leading to public desertification of the web (best case).

A jailbroken model that can hack a website can also easily fix the vulnerability that allowed it to hack it. There is a limited number of such vulnerabilities. Over time, all vulnerabilities that are discoverable by the model would be patched and status quo would be restored (until a more powerful model is released: rinse and repeat).

View on HN

And in the meantime, every site in the world gets hacked. It takes far longer to fix every vulnerability than it does to find one unpatched one. Mythos has led to huge numbers of reported vulnerabilities on every kind of software. If those were all dropped as zero days (which is effectively what an open weight model would do), attackers can choose an unpatched on at their leisure while defenders race to fix them all and update everything.

Hence, the best case. Yet, the damage is permanent. Your favourite trail walking app patching things after the attack does not undo your location getting leaked.

In your scenario, during the disruptive phase, I can imagine apps advertising 'we have Mythos backed security company defending our data'. Reminiscent of showing how much your gun is bigger than your neighbour or gangs on the street, it's truly distopian.

Reply on news.ycombinator.com