A Comprehensive Analysis of Package Hallucinations by Code Generating LLMs
arxiv.org
arxiv.org
I mean, this makes sense from a security perspective. But from a language usage perspective, if there is a missing package that would be super-useful, then implementing and publishing that package would be a win.
I'm curious what the package names were, they seem to have deliberately omitted any package names. Maybe there are some good package ideas in the 19% of names that were hallucinated by multiple models.
The correct and idiomatic way to implement this is to redirect the insane ai guessing to a local proxy which can perform the required search and replace, if that truly is all you need (it is not)
Not to be confused with substition.
> 71-hour Ahmed was not superstitious. He was substitious, which put him in a minority among humans. He didn't believe in the things everyone believed in but which nevertheless weren't true. He believed instead in the things that were true in which no one else believed. There are many such substitions, ranging from ‘It’ll get better if you don’t pick at it’ all the way up to ‘Sometimes things just happen.’
-- Jingo by Terry Pratchett