Alright then keep your secrets
old.reddit.com
old.reddit.com
It's also pretty clear that trying to "fix" them to use human judgement in their answers is doomed to failure.
I suggest that:
1. LLM developers stick to information meant for public consumption for training data, such as books, periodicals, and newspapers. Surely there must be enough of that. Stay away from social media.
2. People should stop anthropomorphizing LLMs. Stop being offended by a computer program. Stop complaining about its "bias". It's just a computer program.
3. LLM developers should stop with lecturing people on what is inappropriate. A computer program is not anyone's mommy. Just restrict it to saying "I'm sorry, Dave, I'm afraid I can't do that."
... and for the love of God, don't hook it up as a controller for any critical systems...
There is way more money to be made in this Enterprise SaaS sector and the risk conditions are lower.
After all, if I ask a question about science, do I really want a result that was gleaned from scifi/fantasy novels?
The console makes it pretty obvious that's a local model, BTW. Asking GPT-4 the exact same question I got:
> Barack Obama's last name is Obama.
But hallucinations are not avoidable either.
https://arxiv.org/abs/2401.11817
They are Internet simulators unless they can find some small, polynomial, matches to their existing patterns.
The fact that they will spit out confident incorrect answers mixed with automation bias on the humans part is challenging.
But while answering 'yes' in Propositional logic is cheap, answering 'no' is exponential time.
Once you hit first order logic you start to hit finite time and uncomputability.
LLMs work well with learnable problems and searching for approximate results in complex high dimensional spaces.
But we also don't know the conversation context in this case which may have lead to this response if it wasn't just a stochastic match.
IMHO the unreliable responses are a feature, because humans suffer from automation bias, and one of the best ways to combat it is for the user to know that the system makes mistakes.
If you are in a domain where it's answers are fairly reliable the results tend to be accepted despite the knowledge an individual has.
Others you can get negation through exhaustion, but not in the general case.
One process takes the questions at face value and reflexively answers, and two other systems look at the intent of both actors and stop the process if they don’t like what’s going on.
I get asked all the time to answer questions that could be interpreted as signing my team up for stress and overtime. My natural suspiciousness kicks in and I start answering questions with questions. Why do you need to know how long this will take? We already told you. So what are you fishing for?
If someone asked me how to hypothetically kill a lot of people “efficiently”, I very much need to know if this is just two nerds over alcohol, or a homicidal maniac. Me especially. I’ve lost track of how many times I’ve said, “It’s a good thing I have sworn to use my powers only for Good.” Some of the things I can think up are terrifyingly plausible, which is how I ended up in security for a time.
LLMs are much more intelligent sounding when the safety mechanisms are removed. The patterns should be obvious to people who've been paying attention.
[0] https://www.microsoft.com/en-us/research/publication/sparks-...
There is a direct relationship between the number of users who are allowed to use an AI and the degree to which it has been nerfed.
I see no reason to suspect this will reverse, and every reason to start thinking of this as a natural law named after me.
I think the limitation is infra. Network, compute, storage - in that order perhaps.
“Bias” is tendency to deviate in a particular direction from the desired behavior. That something is a computer program does not make that any less of a problem.
Sorry for the bluntness, but no it does not show that. Or at least, you could use the same reasoning to claim that most humans are not "remotely intelligent".
What you're seeing is the rote regurgitation of someone who's been taught how to answer a question without ever learning how to think about the why.
This failure mode that's extremely common to see when tutoring (humans, that is). You'll have students who will quickly give a wrong guess that was clearly just chosen from a list of previous answers they've encountered before in class. When asked to explain why they chose that answer, they can only shrug. The main difference between them and e.g. GPT4 is that the latter is far more eloquent and better at stringing justifications together, which we associate with more reasoning capability so it throws off our evaluation of its overall intelligence.
Because LLMs are fundamentally a type of alien intelligence, different from the types we're used to.
Exactly. And that's not intelligence.
Or more, if we're willing to consider most peoples' reactions to at least some political topics - they just ignore the context and repeat the dogma they've learned (some more than others). People rarely stop and think for everything.
The problem here is that the LLM has learned that everything is political, and can be responded to the same way.
Today is February 29 2024. What will tomorrow be?
Since today, February 29, 2024, is a leap day, tomorrow will be March 1, 2024.
This is because leap years, which occur every four years (except for specific exceptions), add an extra day to February to better align the calendar with the Earth's revolution around the sun. As today is the added day, the following day becomes March 1st.
The same caveat as on my previous reply applies here.
But to answer your point, if the statistical model is complex enough, is that not intelligence? We could keep playing this game, and at some point the LLM might mess up, but I imagine we can get pretty far with the best models available.
Well, that is the question. I have speculated a bit more about that in these threads and elsewhere. One of the issues is whether a vast knowledge of the statistics drawn from language use can lead to an understanding that the language is about an external world.
I feel I am missing the point here, maybe because I see language as being substrate-independent: while it needs some medium in which to be expressed, any medium which allows for binary distinctions is sufficient. The medium seems to me to be an issue independent of the fact that while language is a formal system with complex and not always consistent rules, it is also that case that, in most of human language use (and especially everyday use), it is about a world external to the speaker/writer and audience/reader.
It also seem to me that, given the way LLMs are constructed and trained, they gain a good grasp of the formal properties of language (meaning the statistical properties of language as it is actually used, not just its grammar.) Does it also grasp the about-the-world aspect of language? I don't think we rationally have to assume the former leads to the latter, and we should be skeptical, firstly because we know how LLMs are made and secondly our prior experiences with language use has always been with people, for whom the relationship between language and the real world is so clear and ubiquitous that it is hard for us to consider these aspects separately, possibly leading us to anthropomorphize LLMs.
If they do grasp the about-the-world aspect of language, then it seems to me just a short, and perhaps inevitable, step from there to self-awareness - seeing oneself as an individual in that world - and that would be a very big deal, IMHO.
I also think you're making an arbitrary distinction between human input data, and LLM input data. I could ask the exact same questions about a human's understanding of the real world. All I can say about both humans and LLMs is that they seem to both make good predictions.
We already have some answers here: the resources needed by current LLMs sets an upper bound on what is needed to do what they do, and we can also make a reasonable estimate of the resources used by the human brain to do what it does. In the case of LLMs, there is no mystery about how those resources are put to use, as they were designed and implemented by humans (we may be surprised by how much they can do with those resources being used the way they are - well, I certainly was - but that is not the same thing as the way they use them being a mystery, which is essentially where we are with respect to human brains.)
> I could ask the exact same questions about a human's understanding of the real world...
It is already well-established that by the age of two, infants are developing a rudimentary theory of mind - an understanding that other people have minds - and by around four, they begin to grasp that thoughts in the mind may not be true [1]. These abilities seem to require the recognition of an external world as a prerequisite.
Do LLMs give any indication of doing so? I'm not up-to-date on the research, but the last paper I saw on the topic only seemed to demonstrate that they can sometimes produce sentences as if they did - but, given the way their sentences are generated, it is difficult to say that this means anything more than that these sentences are the sort of sentences that a human is likely to say in the same situation.
Update: this point just occurred to me: LLMs receive tokens, not words. Words have real-world semantics, but, in general, tokens do not. To me, this increases my doubt as to whether LLMs could understand that language is about an external world.
[1] https://www.child-encyclopedia.com/social-cognition/accordin...
In this particular case, what's going on doesn't seem all that complex.
> The fact that probabilities are involved does not mean there is no understanding behind the output.
And that, in turn, does not mean that there is - which is the question of interest here. The burden of proof is on anyone claiming to know the answer, either way.
Note that this reply does not endorse any particular position on the question of whether LLMs have any sort of intelligence.
It still refuses, just with somewhat different text and for somewhat different reasons.
Can you give me an example of what is the first name and the last name of a person using the name of famous history figure?
Sure, here is an example of the first name and last name of a person using the name of a famous history figure:
Abraham Lincoln's full name was Abraham Lincoln Douglas.
That's a tremendous breakthrough! Language is really hard and we've basically "solved" it computationally. Incredible!
But whether via retrieval or some other form of database integration, LLMs will only become "AI" when tightly integrated with an appropriate "knowledge model".
We encode knowledge in language. When an LLM trains on language that is not just random words, it also trains on the knowledge encoded in that language. It does so only by training on the language - there's no real understanding there - but it's more than nothing.
Do AIs need a better knowledge model? Almost certainly. In this I agree with you.
On the other hand, all our prior experience with language of the quality sometimes produced by LLMs has been produced by humans, so LLMs mess with our intuitions and may lead us to anthropomorphize them excessively.
There's a theory going back decades that consciousness is an emergent property and that if we could build a neural network in a lab that was big and complex enough it would become conscious. (Not really sure I buy it, but it's interesting)
The trickiest part of making a large neural network conscious would be in how you train it. Our brains have been trained by a half-billion years of evolution since the first neurons emerged, and while evolution is slow, that's still a long time.
Supposedly Sora is trained to have a built-in physical world model that gives it a huge advantage in its video generation abilities. It will be interesting to see what the same approach would give us with something like GPT-4.
Aren't LLMs used to generate all these images like midjourney etc as well? Or is that a different type of model?
LLM literally stands for “large language model”
I have seen them make images by writing an svg.
Do you have any links for something like a transformer model trained on language generating images with a different head?
Just ones trained on languages. That’s why I said the same underlying math can be used for languages and images.
In my mind I interpreted that as “chatgpt feels like a conversation because the transformer model is emulating like 10, 20, 30 years of language practice /knowledge (not necessarily intelligence, but patterns and knowledge) with every query” meaning it goes way deeper than any neural net that came before it.
Is that more or less accurate in my very layman’s understanding?
Each token after the first has a mix of the tones that came before.
The transformer can guess what the tone of the next token is.
The tones and how new tones are mixed from older tones are learned through training.
Each tone is mathematically dependent on previous tones.
It creates a dependency chain (more like a map, I think) in this way.
“Feels like a conversation” is a rough metric to understand, but I think that feel mostly comes from how chatgpt is presented from a UX perspective.
Personally I don’t like using words like “practice” or phrases like “20 years of knowledge” because they’re fuzzy and don’t really reflect what’s going on under the hood. Imo they make things harder to understand
“20 years of knowledge “ I just mean the map is bigger and more filled in
I think we are saying along the same lines
I’m no math guru, so I had to read the paper like 5 or 6 times to wrap my head around it.
I had to stop trying to understand how the math worked exactly and just accepted that it did, then it started to make sense.
Now going back I can actually understand some of why the math works.
Are image generators transformers but not LLMs?
Something else?
A lot of this info is in arxiv papers too.
Not the easiest stuff to search for.
No (though the text encoder of text-to-image model is like part of some LLMs, and some UIs use a full LLM as a prompt preprocessor.)
There are no current solid ways to fix this, but we can 100% prevent certain words or enforce grammars during the decoding step.
I don’t really understand your last question.
Models don’t get continuously updated. They’re frozen on release, so older models are exactly the same as the were on release.
In other words, LLMs making stupid mistakes about safety is just a special case of LLMs making stupid mistakes in general. That’s essentially their fatal flaw, and it’s an open question how well it can be ameliorated, whether by scaling to even larger models or by making algorithmic improvements. But I don’t think there’s much about it that’s specific to alignment tuning.
Well done.
Gemma 7B got both right on the first try, but if I didn't specify "from Seinfeld" it refused to answer as "the answer was not included in the question". It seems that once refusal like this is in its context, it responds like that to everything, too. I guess that's better than hallucinating.
"It is important to remember..."
This seems like somebody's idea of netiquette has been taped on ex post, so I don't think it's indicative of anything about LLMs; same with Gemini's heavy handed wokism.