Ask HN: How long before a “Cargo cult” for AI begins?

The bigger question, I guess, is how can it be prevented?

https://en.wikipedia.org/wiki/Cargo_cult

What do you mean? Like just pasting in copilot snippets w/o understanding them?

Or are you saying something broader?

More than that, I think in time people will become so dependent on it that it will be treated as a deity with all the rituals and supernatural powers that come with it. Primarily because they will have no understanding of how it works. People will believe that there's a magic power that does all the work. It's only a matter of time before it happens.

Oh yeah sure. Actually, a research scientist at DeepMind wrote a paper around this - clarifying some of the misconceptions around LLMs (people implying anthromorphisms that don't really exit).

https://arxiv.org/pdf/2212.03551.pdf

Guess it's just prevented by educating people on what these models are doing under the hood?

Absolutely, within 5 years. Adversarial examples will be treated as magical charms, too.

Reply on news.ycombinator.com