Hacker News Reader

Comment by kylebenzle | Hacker News Reader

Wow! What an absolutely pointless and stupid concern to have, that a terrorist is going to use an an LLM to make a bio weapon.

Does literally no one understand that the only information that is inside of an llm model is information that has been fed into the model? I think more than anything this fake AI boom has really demonstrated how unintelligent most people are.

View on HN

I don’t think it’s a very valid concern, but LLMs can already do a limited level of reasoning to create information not directly loaded into them. Sometimes that reasoning is even correct! The idea here would be that even if you didn’t load that kind of information into them, at a certain level of advancement, they can determine the necessary plans from other information that has been loaded into them.

Well yes sometimes a bullshitted solution may be correct! But the person doing the prompting for a bioweapon will end up with yeast sludge anyway.

>Does literally no one understand that the only information that is inside of an llm model is information that has been fed into the model?

Not literally no one, but Sam Altman recently claimed that we'll be able to ask an LLM to "solve all of physics" soon, so plenty of people who should know better do seem to think they're basically magic.

Well, most terrorists are not very smart, at least on an absolute level. I think even near-future models would be able to help them on a basic operations/not screwing up level. As I said, a problem is the reconstruction of information intentionally omitted. Models can't currently reconstruct even the basic knowledge I have, but it's something they should be able to do based on simple inference rules.

Reply on news.ycombinator.com