We can design and build objects that behave like humans that innately are not. But these things came from humans. They did not come into existence on their own. We have as a species used leverage to move the species forward.
This whole discourse is a complete waste of time.
You're conflating that with a claim about intelligence because the true claim was not explicitly stated. One has to read critically, as if analyzing a poem.
> Does that say more about the state of intelligence today or about the nature of consciousness in general?
Language models don’t have a “day” to write about.
Though I'd argue that the metaphor only works insofar as we believe that toasting bread is something are uniquely qualified to do, just like the original statement assumes that poetry is a uniquely human skill. (Though I do agree that the ability for subjective experience is an essential component of consciousness. I'll be buggered if I know how to define that, though)
Every simple externally observable action or reaction can be replicated by something purely mechanistic.
We can't help but assign our own explaination for everything we see. We see something seek food or avoid damage, and we do those same things, and when we do it we are aware of it and feeling something about it.
But tropism is a very simple system that can have the same outward effect with nothing self aware or feeling behind it.
And on the flip side, a human can perform simple mechanical acts like turning a crank that a motor could do. Turning a crank doesn't prove that a person is merely a machine, nor that a motor wonders about the inner life of other motors.
Whatever the ways are to tease out the difference between a person and an animal or machine, it can't be anything as simple as something it can do better than say a dog. It has to be about what it chooses to do.