What we are actually seeing is that AI is useful to the degree that being wrong is okay. AI’s mess up, and that’s okay with poetry because a human can quickly read the poems and pick out the good ones. It’s not okay when driving.
It's usually serial, so it's not clear to me that this is using different hardware than I use to generate the ideas in the first place. We might be surprisingly close to human-level AI.
Or not.
This is definitely how we wind up with SkyNet...
So I guess we need to get to the point where you give an AI a prompt without a known answer, and instead of confidently spewing bullshit, it can propose a research study, get it funded, find subjects, and complete the study.
Of course, there are easy forms of "science." I just asked it "Is it cloudy in Dallas?" It answered:
It can be cloudy in Dallas. The city experiences both sunny and cloudy days throughout the year.
That is true, but not an answer. It is cloudy and I can conduct the very simple experiment of looking at the sky to get that answer.
By this do you mean that it correctly incorporated what you said and convincingly indicated that it understood the mistake? Because that's not the same thing as it having the truth latently encoded in the model—it just means that it knows how people respond when someone corrects them (which is usually to say "oh, yeah, that's what I meant").
"what's wrong with this code"
or "list 5 ways this can be improved,"
it does often recognize errors and give reasonable improvement suggestions.
I still regularly see videos of Tesla's beta software attempting to pull out into traffic in situations that clearly could have very bad outcomes. I still see so much phantom braking that its a collision risk.
I wouldn't call it dangerous, in the sense that it is done well enough that the person at the wheel should be able to handle it, but it'd crash a lot without an attentive driver.
Its a long way from 99% reliability at this point.
I don't see why we should all panic about the future outlook of the human race in light of these groundbreaking developments.
Good writers also don't waste time with fluffy platitudes that convey little meaning or merely state the obvious.
"Indeed, AI's ability to make mistakes is what makes it so useful in generative fields like art and poetry, while its lack of mistakes is what makes it essential for tasks like driving."