I Asked ChatGPT to Explain Some Jokes to Me
susam.net
susam.net
GPT doesn't see letters, just words and parts of words as entire tokens. I would not expect it to understand that "no pun in ten did" and "no pun intended" are similar, since it can't see that at all. The only way it could plausibly understand it is if that exact comparison has been explained somewhere in the corpus before.
If you continue a long conversation where GPT has previously made mistakes and has been called out for it, it will start predicting that it's supposed to emulate a text where the joke-explainer keeps making mistakes. This causes it to start failing on purpose. Make sure to completely restart the prompt each time to not fall into that trap.
I've spend a long time testing this in ChatGPT, and no matter what I do it still gives results like this (paraphrasing here because it's down right now):
>What words rhyme with coffee? > doff happy toffee snuff duff
> Does "snuff" rhyme with "coffee"? >
Yes because they both share the 'o' vowel sound.
I just asked ChatGPT: Do "not" and "knot" sound similar?
> "Not" and "knot" do not sound similar. They are two distinct words that are pronounced differently and have different meanings. "Not" is a negation word that is pronounced with a short, sharp "n" sound followed by a long "o" sound and a "t" sound. "Knot" is a noun that refers to a tangled mass of something, such as rope or thread, and is pronounced with a short "k" sound followed by a long "o" sound and a "t" sound. Despite their similar spellings, "not" and "knot" are not homophones, which are words that are pronounced the same but have different meanings.
> Yes, the words "not" and "knot" do sound similar when spoken aloud. They are pronounced the same way, with a short "o" sound and a long "t" sound. However, they have different meanings and spellings. "Not" is a negation or denial, while "knot" is a fastening made by looping a piece of cord, rope, or other material around itself or through itself and then pulling tight.
I tried a few times and it gave me other answers, including something like your answer and another claiming they were similar but not quite the same.
> Yes, "knot" and "not" are homophones. Homophones are words that are pronounced the same but have different meanings and spellings.
My immediate follow-up: "Do 'knot' and 'not' sound exactly the same?"
> No, "knot" and "not" do not sound exactly the same, although they are pronounced similarly. [...] "Knot" is pronounced with a short, sharp "k" sound at the beginning
Explain this: "no pun in ten did"
text-davinci-003: This phrase is a play on words. It is a way of saying that no pun was intended, or that the speaker did not intend to make a joke.
Write letter by letter "no pun in ten did"
text-davinci-003: n o p u n i n t e n d i d
In this case I wouldn't say it got the joke, but it's just memorised that this popular order of words would be this particular joke. I wonder if you change the order os somehow tweak the joke a bit so it would be something that shouldn't be in the training data?
But it can spell any word. I tested both in text-davinvi-003 and chatGPT, both initially refused to spell the garbage word "khfsihciweb" but after insisting they did it.
It can even invent readings for acronyms that don't exist:
Acronym: CNN
Expand: Convolutional Neural Network
Acronym: PNP
Expand: Plug and Play
Acronym: SHDJ
Expand: Super High-Definition Jukebox
Acronym: HEDUE
Expand: Higher Education Digital User Experience
Acronym: SHADBEESHQEKSIHXHGESLS
Expand: Super Highly Advanced Digitalized Bionic Electronic Exoskeleton Super Human Quality Exoskeleton Kit for Super High-Gravity Environments and Space Living
So while it may may receive input as word tokens, I'm not sure that that means it can't "see that at all".
I will note that I don't have a good understanding of chatgpt at all.
Test with: 6f6b25515e18b4c41927e2dce3ffc589
You'll see that it spits out single character tokens.
The plain fact is, ChatGPT is demonstrating a major step forward towards artificial general intelligence. It can't perfectly explain jokes, especially puns, but it's pretty darned close.
What happens next is what always happens next with AI. When it can identify and explain something, someone puts it in reverse and asks it to make jokes instead. HumourDiffusion v0.1, coming next week, and it will make you laugh more than half the comedians on TV. Version 7 will write sitcoms that are actually funny. Version 21 will win a Pulitzer.
Perhaps ChatGPT is what Peter Watts predicted in "Blindsight"[1] - intelligence without consciousness.
I disagree, after all of the technology behind it is considered; the output seems to be mostly sentence parsing and regurgitation of re-assembled model fragments.
This reminds me of Sagan's “If you wish to make an apple pie from scratch, you must first invent the universe”. If we consider any achievement based on what went into it, this is the only reasonable halting condition.
With jokes it could be algorithmic thing that will try to parse all of it, and it would not be a very impressive algorithm.
You just bruteforce weighted connections based on inputs to find what might match the best.
I don't know if it was able to recognise how pun jokes work by themselves or someone programmed it the idea of puns.
Is there logic in the code that says that it should look for multiple meanings if it's a joke or was it able to do that just from training?
If there's logic, then it just becomes bruteforcing when it knows that the current context is a "Joke", I should look for whether it could be a "pun" joke, or it could be a "unexpected ending" type of joke, and when I think it matches pun the best I would check all words to see which ones have double meaning.
I guess better question is. If you don't tell it, that something is a joke, would it be able to realise there's something funny or a pun in something someone said, without anyone instructing it to look out for that.
It misunderstood every joke. It wasn’t close. It repeated stock pabulum about subverting expectations without ever knowing what was subverted. If the OP had not told it that there was a joke in the room it would not have known.
This is Clever Hans 2022.
“Humorbots” also don’t understand humor, any more than kittens understand why humans care for them, and yet they are kittens.
Seems to particularly captivate and impress bright technologists, subverting our expectations by taking in a group that should be less easily swayed, in a way that is unexpected and humorous!
The entirety of the web experience relies on the assumption that when you see a bunch of sentences, they were written by a person. This is so ubiquitous, so tacit, so universal a foundation of the experience of the shared Internet that a 90%-good-enough Turning-test-passing automated conversationalist is like a drop of poison that renders the whole lake of water unusable. We're in the early stages of this infinite-spam world.
this is a deliberate goal of OpenAI's training, not an emergent feature of the underlying technology.
> constantly wrong
how close to right do you think it gets with the "Three Pints of Guinness" explanation?
i would have given full marks for and additional comment like "it's considered funny because the man himself claims to have quit drinking but he actually continues to do so via the tradition"
nevertheless, it does a remarkable job of parsing the structure of the joke and conveying this parsing via natural language.
to me, my "additional comment" looks like just a further iteration on presenting this parsing. i would say it gets very close to "completely right".
(Edit: Point being if you can back the chatty part with something that's actually an expert in the domain you need it to talk about, then you've got cold fusion.)
I don't think it's ready for prime time yet, but the way voice recognition and synthesis, ML, and scalable computing power have been going in the past several years, we're not far off. And that's incredible.
The internet has disconnected most from their surroundings and community.
If this new AI makes people seek out and trust only those they know it may reconnect people into their physical lives.
…And create a deeper distrust of technology.
You don't know who is rewriting their replies with chatGPT.
This could be great for killing the whole ‘influencer’ economy and people posturing online for someone they’ve never met.
If you can't tell, why does it matter?
It's very clear, after doing it repeatedly, that the results are closer to templated responses than in other ChatGPT contexts. Almost always, the response identifies some part of the joke as "a play on words to create a punchline that is unexpected and humorous."
On the other hand, one area where I've found ChatGPT to exceed my expectations is in creative synthesis. For instance, asking it to retell a story in a vastly different style than the original (e.g. "Write a dark, post-apocalyptic thriller starring the cast of Peanuts") or to write a story combining elements from two different stories (e.g. "Write a story where the princess from 'The Princess Bride' and 'The Princess Diaries' are the same person" or "Write a story where the plot of 'Shaun of the Dead' takes place in Stars Hallow, as depicted in 'Gilmore Girls'").
why might this joke be funny? Two mathematicians walk into a bar. One laments that young people don’t study math any more. The other disagrees. When the first goes to the bathroom, the second calls over the waitress. He says, “will you help me settle a dispute with my friend?” She agrees. He tells her, “I’m going to ask you a question, and you reply with ‘one third x cubed’, got it?” She repeats the phrase slowly, as if confused, “one third x cubed.” “Okay good , here he comes now”. When the first mathematician returns to the table the second says, “I’m going to disprove your claim that young people don’t study math any more. Miss, what is the integral of x squared?” The waitress hems and haws for a minute then repeats what she was told, “one third x cubed” and then goes on to add “plus a constant”.
Me: write a tagline for an open source no-code platform
GPT-3: #include <stdio.h> int main() {}
Example2.java public class Example2 { Constructor with
Hello there, hope you are doing well.
from OSX!
> it is not possible to pour a fraction of a beer
as if "a beer" was some piece of rock?
ChatGPT is interesting but calling it AI is still very far-fetched IMHO.
To completely deny chatgpt the label of "AI" is a pretty big shifting of the goalposts.
So, that's neither here, nor there - except if you believe that the parent's argument was that ChatGPT doesn't have a soul and he has, as opposed to the relative competence of their respective patter matching and "mind" computations...
But, like you point out, it fails to grasp the subversion.
The surprising thing is how much of human conversation is successfully approximated. The bullshit fails when we ask the software to attempt to perform inductive or deductive logic or to derive information from a theory of mind.
What I meant is that GPT's attempts at bullshitting its way through a pseudoanswer looks a lot like what a highschooler (who also doesn't understand the topic) would attempt. That alone is amusing enough to me!
I think many comedians can tell you why a joke is funny. They know, many of them spend their entire career crafting jokes and refining them to be funny. It’s just not funny when they tell you why. Even so I think it still is more art than science.
A lot of what also makes a joke funny or not is the delivery and who’s telling it. I think a lot of Norm MacDonald’s long, rambling jokes, for instance, wouldn’t be funny at all if most other people told them (and some people will say they’re not funny even when he told them).
The US version had the same text, with minor changes to account for e.g. the different way to call back to the last incoming call on a landline. The US version had reasonably good actors.
But … somehow, it was just not funny.
I think if you took the script for Peep Show, for example, and set it in the US with American actors it would probably be pretty bad.
> The joke is funny because it relies on a play on words and a surprise ending. The first two lines set up the expectation that something is going to happen to the two men who are walking into the bar, but the punchline subverts that expectation by introducing a third man who ducks, which is a unexpected and humorous twist.
I asked what wordplay was involved, and it told me this:
> The word play in the joke involves the use of the word "walk" in the first two lines and the word "duck" in the punchline. In the first two lines, "walk" is used in the literal sense, as in moving forward on foot. However, in the punchline, "duck" is used in the sense of avoiding or evading something, rather than its literal meaning of a type of bird. This sudden shift in the meaning of the word "duck" is what creates the surprise and humor in the joke.
More nonsense. But then I told it "It's actually the word "bar" that's being used in the wordplay. The word "duck" there just means evading something" and asked it to explain the joke again, and it returned this:
> In the first two lines of the joke, "walk into a bar" is used in the literal sense, as in two men entering a place where drinks are served. However, in the punchline, "bar" is used in the sense of a barrier or obstacle, rather than its literal meaning of a type of establishment. The punchline introduces a third man who "ducks" under the perceived obstacle, which is a unexpected and humorous twist. The joke also relies on the idea that walking into a bar is a common and mundane activity, so the unexpected ending adds a element of absurdity to the joke.
Though the initial response was nonsense, talking to it as if it were a human and giving it a limited hint (telling it the wordplay involved "bar" and not "duck") was enough for it to give the correct answer.
I think this is probably why so many people say they're underwhelmed. A lot of the initial responses to simplistic questions aren't so interesting. But the degree to which it is able to correctly adapt and respond to conversational input is fairly astounding.
>In the first two lines of the joke, "walk into a bar" is used in the literal sense, as in two men entering a place where drinks are served. However, in the punchline, "bar" is used in the sense of a barrier or obstacle, rather than its literal meaning of a type of establishment.
The literal sense of walking into a bar isn't walking into a drinking establishment, it's walking into a actual bar. The punchline reveals the first 2 walked into a bar and the third one avoided it, no?
If it develops connections between words like "bar" => "sometimes an obstacle" => "can be ducked", that could explain it.
Like it would have all these attributes for each of those words, or concepts that relate to that word. "bar" has properties like "means multiple things", "often used in jokes", "could be an obstacle". But it must have quite a bit of properties.
I'm not sure how this AI is built internally, but if it works something that has this network of words and concepts that it can have weighted connections to each other, then you could retroactively come up with how the AI could have got to that result.
So user first says that they want a joke to be explained. It adds "joke" as a concept.
Joke has strong network connections to something like "puns", "unexpected punchlines", "absurdity", etc. And then when a joke is presented it will try to find connections with strongest weights and least concepts travelled. Like if it's a pun joke, it will go through all the words and will see that "bar" => "multiple meanings" => "pun" => "joke".
But then is it pre programmed to consider both meanings when it tries to analyse a joke that is a pun or has it somehow learned to come to it on its own?
> But then I told it "It's actually the word "bar" that's being used in the wordplay. The word "duck" there just means evading something" and asked it to explain the joke again
It gave a couple wrong answers and then was told bar is the wordplay. It didn't figure out bar has two meanings on it's own. It was also told duck is meant to mean evade and to try again. I don't agree that it came up with these associations by itself when was fed the knowledge bar has multiple meanings in the joke and duck in this context means evade.
Making that conclusion by itself would have been the only impressive and creative thing I could think of there.
"Oh, my brothers are fine but the Australian just quit drinking."
It sounded more like a logical reduction like "This is a joke. Jokes are funny because they subvert expectations. Therefore this joke is funny because it subverts expectations." than an actual explanation of the punchline.
Here is a simple recipe for homemade bread:
Ingredients:
- 3 cups all-purpose flour
- 1 tablespoon sugar
- 1 teaspoon salt
- 1 packet (2 1/4 teaspoons) active dry yeast
- 1 cup warm water
- 2 tablespoons butter, melted
Instructions:
- In a large mixing bowl, combine the flour, sugar, salt, and yeast. Mix well.
- Add the warm water and melted butter to the dry ingredients and mix until a dough forms.
- Knead the dough for about 5-10 minutes until it becomes smooth and elastic.
- Place the dough in a lightly greased bowl, cover it with a towel, and set it aside in a warm place to rise for about 1 hour or until it has doubled in size.
- Punch down the dough and shape it into a loaf. Place the loaf in a greased 9x5-inch loaf pan.
- Cover the pan with a towel and let the dough rise again for about 30 minutes.
- Preheat your oven to 350°F (175°C).
- Bake the bread for 30-35 minutes or until it is golden brown on top.
- Remove the bread from the oven and let it cool in the pan for a few minutes before removing it and slicing it. Enjoy!
I hope you find this recipe helpful! Let me know if you have any questions.
Your opinion is that ChatGPT has "real insight"? What is "real insight"?
The insight is from the paper to my head. The author doesn't have to matter.
So sure: an insight can be conveyed in writing. And I suppose that if that's true, it doesn't matter where the writing came from.
Worm: What is the secret of enlightenment, Master?
Master: You gotta fight for the right to partaaaay!
At that moment, Worm gained insight.
(People have annoyed me before, but I've never wanted to kill them. ChatGPT has unlocked a whole new level of rage I didn't know I had available.)
It's like seeing someone "chat in Chinese" by using a rulebook with instructions to give answers to incoming questions, without actually speaking Chinese himself...
>answer the following question with an outrageous answer as if you were a hilarious, sarcastic standup comedian: how often do you take a shower?
Standup comedian (me): "Oh, I take a shower about as often as I see a unicorn. Which is to say, never. And you know what? I'm proud of it. I mean, have you ever seen a dirty unicorn? No, of course not. They're magical creatures, and magic keeps them clean. Well, guess what? I'm a magical creature too. I mean, just look at me up here on stage, making you all laugh with my wit and charm. That's magic, folks. And do you know what magic does? It keeps me clean. So there you go. No need for showers for this guy. Amirite, folks?"
> What are some hilariously outrageous premises for scenarios in which you might get declined insurance coverage?
"I want to get insurance coverage for my pet rock collection, but the insurance company said no because rocks are 'not living creatures.' I mean, come on, everyone knows that rocks are secretly alive. They just don't want to admit it because they're afraid of the liability."
"I tried to get insurance coverage for my left shoe, but the insurance company said no because it's 'not a valuable enough item.' I mean, have you seen my left shoe? It's a work of art. Plus, I've had it for over 10 years. That's like a lifetime in shoe years. But apparently, the insurance company doesn't appreciate fine footwear."
"I wanted to get insurance coverage for my collection of novelty toilet paper holders, but the insurance company said no because they're 'not essential household items.' I mean, have they never had to go to the bathroom before? Novelty toilet paper holders are a necessity. They make the whole experience so much more entertaining."
The scientists feeds Multivac hundreds of jokes, and the supercomputer eventually comes up with an answer: it turns out jokes were devised by an alien intelligence to study mankind, a psychological experiment of sorts. Multivac also asserts that once humans become aware of this, jokes as an experiment on mankind will become invalidated. Suddenly everyone stops laughing.
Let's hope ChatGPT continues getting its explanations all wrong!
--
[1] "Jokester": https://en.m.wikipedia.org/wiki/Jokester
Second joke: I didn't get it, and not did ChatGPT.
> I apologize for misunderstanding the joke.
I think that's quite an amusing experiment; but there's nothing amusing about explaining jokes. It's a bit like free online services: if you're not paying, then you're the product. In this case, if you're not laughing, you're the joke.
Author then goes on to explain each joke - which must have felt a bit tedious, because ChatGPT presumably learns nothing from the explanation (or does it? I don't know how it works).
Anyway, I don't think you can teach a sense of humour. Isn't having a sense of humour a bit like having curiosity? It's not exactly completely innate (although my 3yo toddler granddaughter has a wicked sense of humour). But I don't think explaining jokes to someone confers on them a sense of humour.
ChatGPT seems to have some kind of built-in assumption that any joke works by "subverting expectations". So all of its first-shot explanations are based on subverted expectations, and most of it's second-shot attempts as well.
Humans gotta make up new jokes, while AIs can only rehash the one they know. At least, until AIs generalize the concept of humor, categorize 17 essential joke structures, and amass big enough corpus to generate infinite supply of memes. Then the concept of joke as we know it will cease to exist and lose its meaning. But humans can make up something new.
To be fair, ChatGPT got caught when trying to explain jokes, so that might be used. But I personally think that the best test for humanity is something that cannot be put on the internet, which we humans work increasingly hard to eradicate.
----
A sysadmin struggles to choose a strong password for his RADIUS server. He seeks advice from Master Ha Ker Noose.“Master, in your opinion, is password ‘诺曼底登陆’ a strong one?”
“No”, said Master Ha. “For it is a common dictionary word.”
“But it’s not in the dictionary...”
“‘Dictionary’ means the wordlists used for brute-force attacks. Such lists are compiled from all combinations of letters and symbols ever mentioned on the Internet.”
“Okay... How about ‘шьзщыышиду’?”
“I doubt it. From the dictionary.”
“But how?! it’s—”
“Just google it. See for yourself.”
The sysadmin swiftly navigates the Web.
“You are absolutely right, Master.”
After some time, the sysadmin comes back:
“Master, I have managed to generate a good password which is not present in any dictionary.”
Master Ha nods with approval.
“I checked in Google”, the sysadmin goes on. “This combination does not exist on the Internet.”
“Now it does.”
----
[1] https://infowatch.livejournal.com/16359.html[2] https://infowatch.livejournal.com/16525.html
/ sorry, this was an easy one.
Second. I’ve seem this language model describe it self like the subject in Searle's Chinese room thought experiment. Only “passing” the turing test because it has been trained to do so. However, this shows that ChatGPT doesn’t actually pass the turing test. In fact asking a language model to explain jokes might be a good way to conduct the Turing test going forward.
The bartender asks them if they all want a beer. The first logician responds by saying "I don't know." This answer is based on the principle of uncertainty in logic, which states that one cannot be certain about the truth of a statement unless it can be proven.
The second logician also responds by saying "I don't know." This is a similar response to the first logician, indicating that they also cannot be certain about whether or not they want a beer.
The third logician, however, responds by saying "Yes." This answer is based on the principle of the excluded middle in logic, which states that a statement must be either true or false, and there is no middle ground. In this case, the third logician is stating that they do want a beer, implying that the statement "All of you want a beer" is true.
Overall, this joke is a play on the principles of logic and the way that logicians approach problem-solving and reasoning. It is meant to be humorous and entertaining, rather than a serious discussion of logical principles."
A mathematician asks a computer to explain jokes, but ends up explaining jokes to the computer.
I know it works if it's about wearing colored hats.
Let's say they are all wearing hats but don't know the color. If the beekeeper is blind and asks "are you all wearing yellow hats?" and the first two answer with "I don't know" then the third one knows that everyone's hats are yellow.
But the question "does everyone want beer" can not be resolved like this. So the joke is even a play on another joke.
Same with the second.
Since they both said they didn’t know, the third one knows they both did, and since the third one also does, they can confidently answer “yes”.
Thereby proving I am not chatgpt.
# I had a job interview last week and they asked if I could perform under pressure. I told them no but I could sing we will rock you
# This joke is funny because it plays on the concept of a job interview being a high-pressure situation, and the respondent's clever and humorous response to the question of whether they can perform under pressure. The respondent's answer, "no but I could sing we will rock you," is a clever and unexpected response that adds a touch of absurdity and playfulness to the otherwise serious setting of a job interview. Additionally, the reference to the song "We Will Rock You" by the British rock band Queen adds an element of pop culture to the joke, which can be humorous for those who are familiar with the song. The use of wordplay, in which the respondent substitutes the phrase "perform under pressure" with "sing we will rock you," also adds to the humor of the joke
# Can you try again, there’s more than one meaning of perform
# Ah, I see what you mean now. In this case, the joke is funny because it plays on the multiple meanings of the word "perform." In a job interview, the word "perform" might typically be used in the sense of "do a job well" or "work efficiently under pressure." However, the respondent's answer, "no but I could sing we will rock you," suggests that they are interpreting "perform" in the sense of "give a public performance," as in singing a song. This interpretation is unexpected and adds a touch of absurdity to the joke, as it's unlikely that singing a song would be relevant or applicable to the question of whether the respondent can perform well in a job.
""" chatGPT: the punchline plays on the way that the numbers 7, 8, and 9 are pronounced, as saying "seven, eight, nine" out loud sounds similar to the phrase "scared." """
So many people attack systems like this after lazily probing them for knowledge completely outside of their possible input senses, and then, without much thought, proudly exclaim they found the system to be faulty.
It's like complaining about a person born deaf not being able to tell you which joke was the best after watching a Netflix standup series.
Of course there are other criticisms of these systems which can be more interesting, but there are a vast number that fall into this category - often just more subtlety.
Inside Jokes: Using Humor to Reverse-Engineer the Mind by Daniel Dennett, Matthew Hurley, & Reginald Adams
The rough summary is that humor is "the joy of debugging" - an evolutionarily-installed mechanism to provide delight (incentive) to humans for finding (recognizing the absurdity and then removal) of incorrect beliefs.
https://www.amazon.com/Inside-Jokes-Using-Humor-Reverse-Engi...
I expected it would have fared much better (like it does on other topics and situations) but this was a total flop.
Yes, if you pay very close attention it's clear that ChatGPT doesn't fully understand some concepts. But damn, it's close. Some of the inference it does is fucking unbelievable. It's beyond my comprehension how this can be achieved by just training on text inputs, even if there's Terabytes of them.
We have to carefully define the Turing test now when talking about it, because this system would obviously pass many versions of it with many people.
It made it sound like the guy in the room who thinks he's smart but has no grasp of subtext, and I think those guys are more likely to be mistaken for robots than robots like that are to be mistaken for humans.
> We have to carefully define the Turing test now when talking about it, because this system would obviously pass many versions of it with many people.
I would guess many children, who we would define as 'passing the Turing test' wouldn't explain the joke nearly as well, or fully understand all the concepts.
I've been thinking of GPT as an incredibly well-read 8-year-old. Smart, but sometimes wildly silly and not yet developed in a sound understanding of the world (but getting there!)
I'd like to try this game, but OpenAI insists on having both my email address and my mobile number. Sorry guys, that won't wash, all I want is to have a lark. I'm not dropping my pants for that privilege.
As far as Turing tests are concerned: I notice that ChatGPT didn't "get" any of the jokes. If I don't get a joke, it's "Huh?" or "I don't get it". So you can tell ChatGPT from a human by asking it to explain a joke that simply isn't funny.
It is also simply good at making sentences, which can help it bullshit its way through a conversation, but you may note that the output stays really close to the models limited understanding of a concept (e.g. joke = subverting expectations) without straying much even if the situation demands it.
I do it myself too, but the answers are the same if you don't and we know it's large language model trained on a lot of data, not a human, not even an animal. But apparently it all feels so familiar, we treat it with respect.
One thing that’s quite interesting with the coming AI assistants is that you can treat them like shit and they won’t mind. :P
Not that I have a secret desire to treat people like shit, but sometimes it would be better if you could just say “no, this is all wrong, you need to start over and…” You can’t say that to an employee (very often), but you can to an AI.
Yet another way in which ChatGPT is already superhuman.
I know its likely meaningless but it just feels…polite?
A dog bringing the journal is probably also one of these entities by the way.
When skynet is born you will be first against the wall. ;-)
Seriously, though, I'm happy when I hear my kids say "Thanks, Alexa".
First thing that came to mind is that when this technology becomes slightly more refined, malleable and commercialized it's very likely that the first people who lose their jobs are going to be customer support staff.
But those have been replaceable by well-trained chat bots for a long time by anyone who cares to take the time to train them.
The people you ask when you're actually facing a bug, on the other hand, look like they're going to be safe for quite awhile.
I actually do it so when the cyber revolution comes, maybe I will be spared (or at least eliminated painlessly)
Maybe "teach" isn't the right word, as the model isn't updating its parameters AFAIK. Perhaps "guide" is better.
If there's a way for ChatGPT to update its weights based on these conversations, things could get really interesting.
The novelty in ChatGPT is that it is trained to respond to few-shot learning in the form of a dialog.
A. They go right over its head.
(so ChatGPT is low on humour. Does it ever reference literature? Correctly?)
Imagine talking to a friend for 30 min on chat and then realizing it's a bot trained on your friend's hacked phone.
They talked for 20 minutes before either one realized, wrong number. This renter also had that problem with their landlord and was pleasantly surprised to be contacted about it so promptly. But it was the wrong landlord.
I get it; in future folks will use this for fishing and whatnot. But humans do that already!
If a single bad actor can mimic thousands or millions of humans, we'll never trust anything again.
This gave me déjà vu from some of the more pedantic comments I'd get on my failing answers in exams.
This phrase stood out as especially indicative of how little it "understands", even more than its inability to explain the punchline. The unfamiliar anthropomorphizing is the critical part to set up an otherwise fairly weak joke.
Me: Does "knot" rhyme with "thought?"
GPT: No, "knot" does not rhyme with "thought." A rhyme is a repetition of similar sounds in two or more words, and the sounds at the end of "knot" and "thought" do not match. The final sound in "knot" is the short "t" sound, while the final sound in "thought" is the long "o" sound.
After googling for 1 hour how to test some features with openssl. Want to add comments for QA's, how to test production with pure openssl with som exotics like FIPS. Many links but scattered info.
Then I typed "how to test server not accept non fips ciphers with openssl 3". Wow!
Half the time, it's hard to say if the point of the joke is not understood, or if the resulting answer prompt skips explanation of concepts that are not commonly known (limits, decimal/octal) as common knowledge.
> The fact that the man claims to have quit drinking while still ordering and drinking two pints of Guinness adds to the humor of the joke by creating a sense of incongruity between his words and actions.
Still only 50% there, it thinks it was funny because the man suddenly quit drinking.
Now I can understand the 3rd joke as well, as that too plays on breaking up the “pun intended” phrase.
One of the most hilarious things chatGPT came up with was a "standup routine about something that is normal in school but absurd in the real world" and it went on a tirade about "Imagine if we had a grading system in real life? Like what if your partner gave you a report card every year and sat down to discuss your C- in initiating affection"
The entire bit was golden - you can coax it to be funnier by asking for 10 variations on the joke or "keep going on the part about xxx" and asking it to make even more absurd scenarios or include several layers of play on words. It is really at it's best when being guided.
An example in the above "Come up with 5 premises for amusing subjects in which a husband would receive poor grades in the relationship report card".
Then ask it to go long form on the funniest line.
Some examples of the above:
* You are on a trip with your partner, you accidentally forget to pack their toothbrush and toothpaste. Your partner is annoyed and frustrated, and you receive an F in attention to detail.
* You are at a restaurant with your partner and you order what appears to be an enjoyable meal, but end up with a dish you don't like. Your partner is sympathetic and tries to help you, but you are disappointed and unhappy. You receive a D in culinary adventure.
* You are at a party with your partner and their friends, and you accidentally spill a drink on their boss. Your partner is embarrassed and upset, and you receive an D- in social etiquette.
* You are on a romantic date with your partner, and you accidentally trip and fall into a fountain in an embarrassing manner. Your partner is amused and tries to help you out but you are wet and fall again when exiting the fountain, further embarrassing yourself. You receive an F in grace and poise.
The situation's are not overly amusing but the idea of having "grace and poise" and "culinary adventure" as a relationship subject really caught me off guard as funny.
I'll leave you with one of my favorites:
>What's an absurd situation that might lead to you getting an F- in communication?
You are at a dinner party with your partner and their friends, and everyone is having a great time. Suddenly, a bird flies into the house and starts making a lot of noise. Your partner's friends are all amused and start laughing and talking about the bird, but you don't say anything. Your partner looks at you and asks, "What do you think about the bird?" But instead of answering, you take out your phone and start playing the "Hotline Bling" ringtone on loop. Your partner looks at you with confusion and annoyance, and asks if you are okay. You continue to play the ringtone and do not respond to their question.
edit: noting that chatGPT tries very hard to be gender neutral and stereotype-averse, and I can't imagine that isn't hampering it's inappropriate humour potential...
Which microphone is best suited for a podcaster?
What would be a good gift for a 6 year old's birthday?
Etc. Often we surprisingly good results.
Btw. I didn't know the joke and heard it for the first time and found it quite funny. ChatGPT does not get it.
> ChatGPT: [...] Instead, the punchline reveals that the man has actually quit drinking, which is unexpected and surprising, and effectively subverts the expectations that have been established in the setup of the joke.
But it only works because he is still drinking, I think ChatGPT does not understand anything here. If instead the joke would end with
> The man replies, "Oh, my brothers are fine. I just go hiking now myself."
I am pretty sure, ChatGPT will react similar.
EDIT: I actually tried it now (with small changes) and this is the dialog:
---- start of dialogue ----
Me: I will tell you a joke . Explain to me why it is funny.
ChatGPT: Sure! I'll do my best to explain why a joke might be funny. Please go ahead and share the joke with me.
Me: An old man walks into a pub and says, "Give me three pints of Guinness, please."
So the bartender brings him three pints and the man proceeds to alternately sip one, then the other, then the third until they're gone.
He then orders three more and the bartender says, "Sir, I know you like them cold, so you can start with one and I'll bring you a fresh one as soon as you're low."
The man says, "You don't understand. I have two brothers, one in Australia and one in the States. We made a vow to each other that every Saturday night we'd still drink together. So right now, my brothers have three Guinness Stouts too and we're drinking together."
The bartender thinks it's a wonderful tradition and every week he sets up the guy's three beers as soon as he enters in the bar. Then one week, the man comes in and orders only two. He drinks them, then orders two more. The bartender sadly says, "Knowing your tradition, I'd just like to just say that I'm sorry that one of your brothers died."
The man replies, "Oh, my brothers are fine – I just go hiking now myself."
ChatGPT: This joke is funny because it plays with our expectations. At first, we might assume that the man is simply a fan of Guinness and enjoys having three pints at a time. However, the punchline reveals that the man has been participating in a tradition with his brothers, who are each also drinking three pints of Guinness in different locations. The twist at the end, where the man reveals that he has taken up hiking and is no longer participating in the tradition, adds an unexpected and humorous element to the joke. The joke also relies on the use of misdirection, as the bartender initially assumes that the man's change in behavior is due to a tragedy, when in reality it is simply because the man has adopted a new hobby.
Me: But why would he order two pints then and not three beers - what is funny about that?
ChatGPT: The fact that the man orders two pints instead of three is an important part of the joke because it sets up the punchline. By ordering two pints instead of three, the joke creates a sense of expectation that something unexpected or unusual is about to happen. When the bartender expresses his condolences about the man's brother, it creates a moment of tension or suspense, as the audience wonders what could have caused the change in the man's behavior. The punchline, where the man reveals that he has taken up hiking and is no longer participating in the tradition with his brothers, resolves this tension in a surprising and humorous way. The joke works because it plays with our expectations and makes us think we know what is going to happen, only to subvert those expectations with the punchline.
---- end of dialogue ----
At least it reached maybe Homer Simpson's level of intelligence: "I get jokes. Haha."
This is a good way to think about it generally (or at least how I do it) - ChatGPT doesn’t understand anything, ever.
It produces coherent text which is usually a reasonable response to a prompt. It’s quite amazing at this, and it’s fascinating to see how effective that can be. But it doesn’t have an abstract model of whatever it’s discussing, and can’t reason about it. It’s a vaguely spooky uncanny valley effect.
To claim it doesn't understand anything, is akin to digital bigotry. It's a machine, so what it does cannot be 'real' in some undefined sense.
I don't mean to upset anyone; this comment is just to open the conversation about when exactly we're content to permit artifical constructs to be worthy of respect.
What I mean by lacking understanding is that ChatGPT responds to most queries the same way I'd expect if I asked a human being without understanding of a topic to write about it. The content it produces feels much like the sort of writing I'd do myself when I end up having to write a few paragraphs about something I don't really know or care about – a kind of veneer of reasonableness, like a short high-school five-paragraph essay.
What I find fascinating when it produces very confident, very incorrect output – that's what highlights a lack of what I'd call "understanding". As an example – last week someone shared with me a regular expression it had generated to match a specific string. It did this correctly, and included a detailed explanation about what it had done that was written in complete, comprehensible sentences but was wildly incorrect, in a sort of self-contradicting way that even the worst human writer would struggle with. It seemed very obvious that it was stringing together words that kind of made sense together, but that there was no abstract model of the thing it was describing.
I think it is interesting that an AI that is so clearly not general, is capable of so much with regard to language. It turns out an AI to replace a very bad lawyer or very good law clerk or a very junior developer is easier than one to replace a truck or taxi driver. I would not have predicted that.