edit: I get it, it's not a popular opinion.
But am I wrong?
If the problem of hallucination in AI has been solved, maybe I missed it?
edit: I get it, it's not a popular opinion.
But am I wrong?
If the problem of hallucination in AI has been solved, maybe I missed it?
But they're right much more often than they used to be. If you haven't tried a near-Frontier model lately (say, Claude Opus or ChatGPT Sol) you probably need to update your priors for just how often they can be right.
AI is being used in contexts that involve life and death. Being right more often is not good enough in that context. If we are going to put AI in drones and have them autonomously acquire and fire on enemies, perhaps the fact that all AI hallucinates at all makes it morally and ethically unusable for purposes in which the stakes are very high, such as life and death.
This is what scares me about it. And also what I was able to accomplish air-gapped with a Ryzen 7 and RTX 3060 12GB scared me.
This is not the kind of thing we should all have to speculate about, someone should have solid answers. Perhaps the fact that some, and maybe most, AI models are black boxes even to those that trained them, should have been the first red flag and that was years ago.