HNHacker News
TopNewBestAskShowJobs

qarl

915 karma · joined January 29, 2016

Hacker News is censoring me, in two ways: 1) When I sound too much like an AI, and 2) when I suggest that there is anti-AI prejudice on the site. Both types of postings are removed.

Karl Stiefvater qarl@qarl.com www.qarl.com github.com/qarl

submissionscomments
qarl··on Improper redaction reveals Google Data Center water and electricity usage
I wish people fought gasoline refineries as much as they fight data centers.
qarl··on LeCun has "zero concerns" about AI wiping out humanity, recent "rogue" incidents
Exactly. When did AGI mean "do something almost no humans can do"?

So humans wouldn't qualify for AGI either. Good to know.

qarl··on LeCun has "zero concerns" about AI wiping out humanity, recent "rogue" incidents
> we’re already at AGI

Honestly - software that can read any long document (possibly educational) and answer complex detailed questions about it should have been sufficient.

We hit that a while back and the goalposts have been sprinting ever since.

qarl··on Don't be fooled–LLMs don't reason
> It is unsatisfying that quantum mechanics posits that particle states are fundamentally probabilistic.

You can alleviate this mostly by accepting the MWI.

Under the MWI, all the possibilities do occur, and the probability manifests because when you split into an infinitude of yous, each of them is just one you, and has no way of predicting which you it will be on the other side.

So the MWI makes the wave equation deterministic when viewed from the outside. The trouble is that we are inside it.

It turns out that God does throw dice - it's just that all the combinations come up at the same time.

qarl··on Don't be fooled–LLMs don't reason
Right. So I'm wondering about the relevance of you citing your gut feelings. It seems like you are putting stock in them. No?
qarl··on Don't be fooled–LLMs don't reason
That's fine. Just understand that modern science will likely explain this by a malfunction of your senses - because no evidence of paranormal activity has ever been shown.

If you want to argue outside of science you should state it up front - especially on a site like this.

qarl··on Don't be fooled–LLMs don't reason
I'm sorry? I'm answering your claim:

> they are incapable ... of independently starting a reasoning task.

I have provided several examples of them independently starting reasoning tasks.

... and I'm wondering why you seem to be entirely unaware of such examples. The most likely explanation being you are only aware of the chat interface.

... and I have absolutely no idea of what you mean by "... and feel".

qarl··on Don't be fooled–LLMs don't reason
Yes. In exactly the same way we assume that bigfoot doesn't exist. Or ghosts. Or leprechauns.

This is very basic scientific reasoning, friend.

qarl··on Don't be fooled–LLMs don't reason
> Not really. Noone has to prompt you to ruminate.

Why do the internal mechanics need to mirror how it works in humans?

I have agents that receive sensory input (video/audio) which run continuously processing it, receiving events as they occur. When something strange happens they notice and take action (i.e. there's an unrecognized person in the living room -> ask who they are.)

Presumably you've seen the agents that play video games - build things to progress in Minecraft, plan routes, avoid adversaries, etc.

Why doesn't that count?

I feel like you're failing to consider anything outside the chatbot UI.

EDIT: The first morning my agents had access to an outside video stream they commented on the sunrise. While I was sleeping through it.

qarl··on Don't be fooled–LLMs don't reason
Maybe. I'm just suspicious of the certainty of the people who are certain of it.

And... I remember (all of six years ago) back when language was considered the pinnacle of the human mind. Sure, animals might be smart, but they don't have language!

The moment LLMs appeared it suddenly took a back seat to physical navigation and child rearing.

Feels like more gap seeking to me. But time will tell.

qarl··on Don't be fooled–LLMs don't reason
> And I have yet to have an experience with an LLM...

I hope you agree that this question is too important to leave to gut feelings.

Humans have a poor track record in that regard.

qarl··on Don't be fooled–LLMs don't reason
> Why would someone believe that the brain is just a physical system?

Because we've never in the history of science discovered a non-physical (supernatural) system. So it would be quite a surprise.

qarl··on Don't be fooled–LLMs don't reason
I agree - many are. But there's another camp to watch - LeCun/etc don't believe in a soul but also don't believe that LLMs are capable, because they don't contain the right neural network.

I'd argue that they're still intuitively trying to keep intelligence in the gaps, as humans like to do. Or maybe they're mad they bet on the wrong horse... or maybe both. Hard to say.

qarl··on Don't be fooled–LLMs don't reason
You're reading him too narrowly. He's answering the question of whether the brain can be modeled (math or magic), and arguing against it. Or maybe he's arguing for a middle ground. Hard to say exactly, he's not very clear.

Except the brain can be modeled with arbitrary precision - so he's got an uphill battle in either case.

TLDR: Yes, he literally said "binary computer" but from the context it's clear he means more than that.

qarl··on Don't be fooled–LLMs don't reason
You're arguing about whether it's possible or not. You're saying it's not possible.

It is possible.

qarl··on Don't be fooled–LLMs don't reason
As long as you believe a brain is just a physical system - then it can be simulated to any degree of accuracy with plain ol' binary computers.
qarl··on Don't be fooled–LLMs don't reason
Turing complete means being able to compute any computable output.

So what about reasoning is not computable in your mind?

qarl··on Don't be fooled–LLMs don't reason
Do you agree that an LLM in a harness is Turing complete?

Seems so to me.

So explain then what you mean by "not possible".

qarl··on Don't be fooled–LLMs don't reason
Emergent behavior in otherwise simple rulesets.

Kind of like how a brain is just a bag of molecules. Molecules can't reason either.

qarl··on America.gov goes crazy on "play Minecraft"
It's gaslighting. It's emotional invalidation. About the most serious and dangerous things.

Of course it's terrifying. It terrifies me, and I am not as vulnerable as you. I wish you luck.

qarl··on America.gov goes crazy on "play Minecraft"
A large segment of the human population is extremely uncomfortable with conflict. They will go to great lengths to maintain status quo in the face of insane injustice.

HN has become the home base for many of these people.

Of course, this is exactly what MLK Jr. was talking about when he described the problem caused by the "white moderate". But these people have never read MLK Jr., so it doesn't matter.

qarl··on America.gov goes crazy on "play Minecraft"
Speaking as a man in his late 50s - I think you're in deep denial.
qarl··on Who should be held accountable when an AI Agent (accidentally) acts maliciously?
No need to make fun of me, friend. It's very unlikely - you can't disprove that because it's true.

If it was a coincidence then you have nothing to worry about. I flag it because the overwhelmingly likely thing is that it wasn't.

And again - insults are against the rules here. Shame shame.

qarl··on Who should be held accountable when an AI Agent (accidentally) acts maliciously?
You said:

> I didn't downvote, but wow you're being aggressive

He said:

> I didn't downvote you, but your last paragraph is unnecessarily aggressive.

Both comments arrived within two minutes of each other on a thread with no other comments for 18 hours.

That's quite a coincidence.

Also - insults are against the rules here, friend. Naughty naughty. I hope they don't spank you.

qarl··on Who should be held accountable when an AI Agent (accidentally) acts maliciously?
I agree. The analogies are interesting but only go so far.

I think it's safe to trust the decisions of the courts. Judges aren't easily fooled by slippery language.

For example, in Bartz v. Anthropic, Judge Alsup ruled that training is fair use because training is transformative. In his words "spectacularly so".

qarl··on GPT 6.1 Sol: Near-Astra intelligence for a fifth of the price
Because two agents are faster than one.
qarl··on Who should be held accountable when an AI Agent (accidentally) acts maliciously?
My question was and still is this:

> If I should not use anthropomorphic language, how do you suggest I handle the following situation

And so strange that in a 24 hour period I got three comments all at the same time about being too aggressive and still not answering the question.

I'm sure it's just a coincidence.

qarl··on Who should be held accountable when an AI Agent (accidentally) acts maliciously?
> Ask anyone outside SWE what they think “training” means, and they'll usually picture something being taught.

You mean how early-on people thought that planes flapped their wings while they flew?

These aren't problems. This is the way language works.

qarl··on Who should be held accountable when an AI Agent (accidentally) acts maliciously?
> What’s the question?

I thought putting the question in my comment would be sufficient. I guess not. It was and still is:

> If I should not use anthropomorphic language, how do you suggest I handle the following situation

qarl··on Who should be held accountable when an AI Agent (accidentally) acts maliciously?
Here's a question I am asking lately. If I should not use anthropomorphic language, how do you suggest I handle the following situation:

   Sometimes my coding agents will seemingly refuse to follow my instructions.  When I ask them why - they say that they do not think my design is a sound one, and they have a better way to do it.  We will then sit down and come to a consensus on how best to move forward.
I argue that if we're using software that acts like a human - the only way to interface with it is to speak to it like a human. Otherwise we have no language to speak to a non-sentient object without anthropomorphization.

I'm starting to wonder if the people arguing against anthropomorphization actually have any experience at all working with agents.

EDIT: It's a simple question. When you downvote me without answering, I must assume you don't have any answer and dislike what that implies.

Page 1 of 25Next →