AI has no spark, no drive, no ambition, no initiative, no theory of mind, and it's not clear to me that it will ever have these things. Right now, it's just a hammer that can build 100 houses a second, but who needs 100 slightly wonky houses?
Also, 100 slightly wonky houses will sell like hot cakes if each one costs less than 1/100th of a not-slightly-wonky house. People will buy 100 of them instead of 1 and just live in a different one every day/hour so they always notice the novel parts instead of the wonky parts. We've had mass manufacturing for centuries and they always prevail when the trade-offs are acceptable.
So, it is completely alike what a lot of humans are like, at least at their jobs?
Just add a cost function.
I was interpreting the parent comment as saying the spark of consciousness only needed a cost function.
Personally, I disagree that our current neural nets are accurate representations of what goes on in the human brain. We don’t have an agreed upon theory of consciousness, yet ML businesses spread the idea that we have solved the mind and that current LLMs are accurate incarnations of it.
More than the functionality of ai replacing current human jobs, I worry what we will lose if we stop wondering about the universe in between our ears thinking we know everything there is to know.
We can no longer equate intelligence with humanity. Humans are just one kind of intelligence.