everything so far looks to me like improvements on the pocket calculator, bearing in mind that an order of magnitude difference in scale really still is a difference of kind, they're still orders of magnitude improvements on pocket calculators (which admittedly is something of a different kind). There's a very important particular kind of human intelligence that machines can't seem to do at all, like Einstein discovering general relativity or Fleming discovering antibotics...which sounds like I'm cherry-picking human intelligence at its best, but I'm really pointing out a kind of information synthesis on the basis of reacting to unexpected information.
I have trouble articulating it, but I can see that LLMs and chess engines don't do the slightest hint of it.
I'll be concerned when machines show the slightest hint of it, but we're playing a ball game in a sphere they can't even touch yet.
I'm genuinely continually boggled that people are not seeing this difference and feeling threatened by machine "intelligence", although they are encroaching on something thought uniquely human, and I don't think the brain is doing some kind of information processing that can't be done in any other medium, but the number of connections and kind of processing in the human brain may make it hard with current technology. The number of connections in the brain is staggering, and we certainly can't simulate anything of its scale on the scale of computer we have now, so I don't know what it will take to get any bootstrap on the kind of intelligence computers aren't doing.