It's quite unclear if we'll ever hit the point where (like, a car for example) someone who has no idea how it works gets as much out of it as someone who does.
That's one thing that a lot of us tech seem to forget, the way we interact with technology is completely different from how most of the population does. It's not just a matter of a few degrees of difference, we operate in entirely different manners.
I seriously doubt that the average driver can get the same out of their car as a trained race driver can.
Most people don't find themselves using a pickup truck when they're trying to race motorcycles, or accidentally get into a Miata when they want a minivan, because even laypeople know what those broad archetypes (coupe/van, truck/motorcycle) are, and signify. With LLMs, that's not the case at all.
About the last thing we need is a law requiring a license to use ChatGPT.
Of course, the license requirement wasn't meant literally, but at least some basic understanding that not downloading everything from everywhere is a good thing to do, or that clicking on that link and entering your details is okay just because the mail said "WE ARE YOUR BANK AND YOU NEED TO GIVE ALL DETAILS!!!" and so on.
If you point that out, you are often meet with "Ah. Technology is so difficult to understand. They should make it easier."
The problem is, some people are under the assumption that AI is technology and technology can't ever be wrong and if it's wrong it's the fault of someone else.
I think people have a greater weakness for trusting other humans. The world is full of people who do destructive things to themselves and others because they trusted confident liers or other believers who had themselves been fooled. Even on a small group level, people tend to favor ideas from those with higher social status rather than evaluating the ideas themselves. AI not being a respected human wouldn't have that social power.
Not that this is necessarily a good thing, but we have seen in the last few years what can happen if people believe everything someone says on some social media channels.
That's fantastic! That's the ideal scenario, for all technology: a useful tool.
There's a good chance you don't understand how your computer works either. The quantum physics that makes your SD card work, the startup sequence for the PCIE devices in your computer, the wrap around gate's used in your CPU, how the doping materials are mined, how the combine is constructed that was used to make the bread on your sandwich, etc.
That's great, and such a relief. You don't have to waste your time on carrying around all that knowledge that took mankind billions of man hours to accumulate. You can just get personally interesting shit done, and use your sandwich at lunchtime without a license.
I don't need to understand the inner technical details of my computer, that's true. But I need to understand that connecting to a world wide network can open up a can of worms not only harming me but others along the way as well.