Hacker News Reader

Comment by ren_engineer | Hacker News Reader

I think we are hitting the flywheel stage where AI is going to be able to start improving its own architecture and performance. Biggest thing holding AI back right now is performance efficiency. Will be interesting to see how AI is used to come up with chip designs and maybe even improvements on its own model. AI can effectively bootstrap itself and improve itself so it can then improve itself again

View on HN

> AI can effectively bootstrap itself and improve itself so it can then improve itself again

Does this not frighten anyone else? Or am I alone in this?

It has been pondered on and raised terror under the name "intelligence explosion"

https://en.wikipedia.org/wiki/Technological_singularity#Inte...

You are definitely not alone. I am really excited about ChatGPT but it also has me ruminating about the consequences.

it's classic sci-fi Skynet type stuff. AI for example might come up with amazing new nuclear fusion reactor designs so it has access to more energy to do more processing. Could be great, could turn out horribly

You are not alone.

Terrified.

The LLMs don't perform accurate math, particularly floating point, so I'm not sure how they going to be improving their own architectures, since the neural nets rely on weights, not textual tokens. These models are all designed, fine-tuned, adjusted and fed data by humans.

You act as if AIs are independent agents in the that have goals to modify themselves. Human engineers are doing that. The models don't have any independent goals. They just respond to prompts.

Reply on news.ycombinator.com