What if we let AI govern us?

inevolin.substack.com

3 points·iljanevo··7 comments

That is the eventual plan I suspect. It will be claimed to be non-partisan, blah blah.

> an intelligence with no campaign to fund, no donors, and no cousin in the oil business, built to optimize a single goal of human prosperity.

I'm sorry, but come on. this is ludicrously naive.

who writes the system prompt? who's allowed to approve changes to the system prompt?

and those people...can't be lobbied or bribed? why not?

LLMs are a big pile of GPUs. they are not a magic genie. don't ask them to fulfill your wishes.

A pile of GPUs who recently solved 10 long standing math problems. Those pile of GPUs are, in my ignorant opinion, smarter than the people we have running our countries [at least on an IQ basis].

again - who decides the system prompt?

"it generated a complicated math proof" doesn't mean anything in this context, because the prompt was uncontroversial, it was "try to solve this math problem".

you have your big fancy government LLM. one person wants to prompt it "generate a proposed peace plan with Iran" and a different person wants to prompt "generate bombing targets in Iran".

those two inputs can't co-exist. you have to choose between them. the process of making those choices is called politics. you cannot simply outsource it to a chatbot.

No.

LLMs are not intelligent

it's not clear that's a requirement for this

Reply on news.ycombinator.com