Comment by cchance | Hacker News Reader

Comment by cchance | Hacker News Reader

I'm fucking sorry but if you gave me that tape math problem i would have given the same answer! I'm so sick of people writing trick questions for AI's and then being like SEEEEEE it failed! And its like no you gave it data and a question and asked it to solve the question, it gave you the best answer it had... Like wtf.

And i'm pretty sure the average person when asked would say the same thing and be like "duh" even though technically based on the minutia it's incorrect.

But AI is put into places where you wouldn't ask the average person.

It's treated like a genius and that's what it gets measured against.

It actually did really well 3/3 tries correct when given the text prompt and a simple chain of thought appended to the end of the prompt. What's interesting is that combining it with another mode (image) caused confusion, or rather introduced another source of potential errors.

How is this a trick question? Maybe I am dumb but I would have no idea how to solve this.

to be fair, this question does not require any advanced math beyond knowing how to compute the area of a disk

to me, the impressive part of gpt is being able to understand the image and extract data from it (radius information) and come up with an actual solution (even though it got it wrong a few times)

for basic math I can do

  python -c "print(6/9)"

Reply on news.ycombinator.com