Only thanks to seeing numbers in vast amount of text it was trained on, it is able to do common math relatively well, and anything uncommon very poorly.
But the truth is we don’t know. I personally wouldn’t be surprised if they do train it on a whole bunch of calculator output to boost its numerical reasoning.
[0] https://youtu.be/0A8ljAkdFtg 7:21
Plus from the video: "do you have a thorough idea what OpenAI is doing, neither do I" - cut to strobe light and rock music. Jeesh, can't see that as support.
> Plus from the video: "do you have a thorough idea what OpenAI is doing, neither do I" - cut to strobe light and rock music. Jeesh, can't see that as support.
The hell are you talking about? There's no strobe there, he just goes to a slide with a white background, and the music is very quiet compared to his voice and not at all something I would call "rock".
Maybe joe_the_user went overboard with calling it strobe light, but this is definitely not "just a guy talking". I don't know how people call this style of videos but it's very tiresome - constantly zooming in and out, full of sound effects (glass breaking, snaring, what not), changing backgrounds, changing lights, everything is just uncontrollably moving and shaking every 5-10 seconds or so.
There are valid criticisms that can be made, but they are different from the criticisms joe_the_user actually made.
His usual viewers will be familiar with his “ML news” videos where the parody is way more in-your-face.
His usual style of video is a rather dry screen capture of him annotating a PDF, so I guess he does it for some lighthearted relief.
I guess it can get philosophical quickly, but people are very quick to read too much into a fancy text-generation tool. We talk about it "learning" but it can't really learn anything, because it is not an entity with agency. It takes an input and responds with an output.
I'm not saying it's not impressive, but it is manifestly nothing like a mind.