But because of its current lack of optimization for accuracy, we shouldn’t consider it disruptive because it’s not yet proven technology?
You can call it dangerous but you can’t call it useless. It’s also only going towards improvement from here, including drastic reductions in hallucinations.
You have to remember too that AI models are generally attempting to interpret the intent behind the prompt, so many of these crazy articles are happening because people aren’t yet good at writing clear instructions for AI and AI isn’t yet mature enough to disambiguate poor instructions in its output and is trying to deliver on unclear instructional intents.