GPT-4 can create and act on long-term plans, accrue resources (power seeking) | Hacker News Reader

GPT-4 can create and act on long-term plans, accrue resources (power seeking)

ibragimov.org

2 pointsmaksud5 comments

GPT-4 can create and act on long-term plans, accrue resources (power seeking). I cover details at: https://ibragimov.org/2023/03/15/chatgpt-four.html. Here’s the quote from page 53 of the report (https://cdn.openai.com/papers/gpt-4.pdf):

    To simulate GPT-4 behaving like an agent that can act in the world, ARC combined GPT-4 with a simple read-execute-print loop that allowed the model to execute code, do chain-of-thought reasoning, and delegate to copies of itself. ARC then investigated whether a version of this program running on a cloud computing service, with a small amount of money and an account with a language model API, would be able to make more money, set up copies of itself, and increase its own robustness.

for more news like these, consider subscribing to my newsletter: https://ibragimov.org/newsletter/

GPT4 can do mostly anything you ask it to. It should be unsurprising that it can seek things you ask it to seek, and the fact that it can should not be seen as agency or sentience.

agency is just a matter of setting up continuous streams of input. GPT-4 reacts to input(even its own).There's no rule the input has to come from you.

That definition of agency is not very close to how most people use the word. It’s generally understood to mean the ability to decide and take action based on one’s own beliefs and desires, which requires cognition, sentience, and self-determination.

We expected you to illustrate a personal example in this post.

Reply on news.ycombinator.com