That prediction and analogy to low-background steel has been made 128+ times before on HN: https://hn.algolia.com/?dateRange=all&page=0&prefix=true&que...
Five pages of results; past the first page, there are only five relevant matches. https://news.ycombinator.com/item?id=23895706 three years ago (when it wasn’t yet a problem, but it was obvious it could become a problem), then the rest all within the last year (mostly this year) (when it is obviously becoming a problem), about thirty in total, half of which are multiple related comments. So the true number of times the prediction or analogy has been made is under twenty so far, and they’re mostly saying “like someone recently said” rather than coming up with the analogy by themselves.
The number seemed unrealistically high and I was curious. Now I have an answer! :-)
"The limits of my language mean the limits of my world"
Our entire personality and sense of identity is nothing but the reflection of ourselves in relation to eachother. The summation of all cultural input. A man in a void is no more than a beast.
So really there’s not a distinction between language models and people. Other than the lack of decision making and planning, the actual communication side is identical.
The possibility that we really are just stochastic parrots is too much for people.
What prompts are you using? It helps me make decisions every day involving complex and nuanced criteria. GPT-4 (especially 32k API + plugins) is better than 95% of the directors, PMs, and CEOs I have worked under.