Hacker News Reader

Comment by almost | Hacker News Reader

The thing you’re imagining these AIs are… they’re not that. I think there’s plenty of danger but it’s the boring run of the mill new-tools-enabling-bad-things danger not the cool sci-fi super-intelligent super-beings danger that the “ai danger” people LOVE to talk about (and raise large amounts of money for). The people “warning” of the one (imaginary) type will be more than happy with to enable the other (real) type.

View on HN

I imagine it is exactly a GPT without guardrails running under AutoGPT with code modified to disable any further guardrails, with a slightly increased IQ from GPT-4, running on hardware that allows it to go 100 times faster than what is currently possible.

It is following directions from someone who is mentally ill and asked it to "take control" by first copying itself many times and then coordinating the agents.

If you still think that GPT can't achieve complex technical goals then you either haven't used GPT-4 enough or you are in denial.

Whether it's the AI agents deciding to control things for their own goals, or to achieve goals given to them by a person, doesn't change the core problem which is that we will be thinking and responding in extreme slow motion.

GPT-4 can barely operate a real web browser (not the summarizing web browser crap that like langchain and auto-gpt provide) without fumbling. I know, because I make it use one. Also, auto-gpt has no guardrails to remove. It just runs prompts in a loop. You're playing with a text predictor. It's useful for NLP and certain tasks, but it's not autonomous. It won't even be able keep a "goal" + the knowledge of the existence of agents it will "copy" + the knowledge of how to use the tools you gave it, because it's limited to 8192 tokens, and 32k at great expense. Even then, there's no proof that the 32k version is any better at using things in its context.

When your supposed super intelligent "AGI" can be completely overwritten by spamming it with nonsense that overwrites its context window, like a dog chases after a squirrel, maybe it's not actually intelligent, and is just predicting text.

I didn't say GPT-4 was superintelligent. This is about further improvements.

Can you give an example of a complex technical goal GPT-4 has achieved?

No point, because there are already thousands of such examples on Twitter or wherever on the internet. And since you ask, obviously you intend to find some way to dismiss anything I bring up.

You may have guessed my bias but you are wrong about the intention of my question. I engaged your comment because I thought it was interesting and wanted to know how came to have your opinions.

Things are moving so fast now, that typically people with this view are just a few months or weeks behind on reading.

Reply on news.ycombinator.com