Hacker News Reader

Comment by emtel | Hacker News Reader

Do you think people should continue developing AI up until the point that there is evidence that AI is facilitating biological weapons development?

I think we should stop before then. But that necessarily means that there will not be evidence at the time that we stop.

View on HN

We also need to stop before the AI opens a portal to hell. There's no evidence of that happening... but by the time there's any indication it's possible, it's too late.

This is rubbish. By that token, computer development is also facilitating biological weapons development. A better MacOS (or Windows, I don't know) leads to better weapons. They should clearly stop developing computers and OSes. Developers of nice test-tubes are also facilitating bioweapons. Your local O-ring manufacturer, your local medical-grade freezer manufacturer etc. are all culpable. The problem is the bioweapon, not the LLM.

Yeah but trends seems to point strongly that upcoming models in the next few years will make it orders of magnitude easier to develop one with no real expertise.

An OS developer is just as culpable as a researcher directly training AIs that (1) are capable of building bio-weapons and (2) have shown consistent and increasingly severe misalignment? Among other things...

That doesn't make sense.

If people were capable of making biological weapons they would already be making them.

Terrorists are so incompetent that they buy bring kitchen knives into the street and just go mental on people. No random person is going to successfully mass produce and release a bioweapon.

China and Russia don’t need AI, they already make bioweapons.

Reply on news.ycombinator.com