Hacker News Reader

Comment by yandie | Hacker News Reader

I got a different answer with GPT 3.5

> If the word "push" is written on the glass door in mirror writing, it means that from the other side of the door, it should be pushed. When you see the mirrored text from your side, it indicates the action to be taken from the opposite side. Therefore, in this scenario, you should push the door to open it.

View on HN

I also get the wrong answer with GPT 4

https://chat.openai.com/share/4373c945-88b8-4742-8a2c-76fff2...

> You should push the door. The word "push" written in mirror writing indicates that the instructions are intended for someone on the opposite side of the door from where you are standing. Since you can see the mirror writing from your side, it means the text is facing the other side, suggesting that those on the other side should push. Therefore, from your perspective, you should also push to open the door.

Strange, I get the right answer on GPT4

> If the word "push" is written in mirror writing and you are seeing it from your side of the glass door, you should pull the door towards you. The reason for this is that the instruction is intended for people on the other side of the door. For them, the word "push" would appear correctly, instructing them to push the door to open it from their side. Since you are seeing it in reverse, it implies you are on the opposite side, and the correct action for you would be to pull the door to open it.

Yeah LLMs are not consistent.

Here's another one.

This is a classic logic puzzle - usually about ducks.

There are two pineapples in front of a pineapple, two pineapples behind a pineapple and a pineapple in the middle. How many pineapples are there?

When you use ducks, Gemini can do it, when you use pineapples it cannot and thinks there are 5 instead of 3.

ChatGPT 3.5 and 4 can do it.

The even funnier thing is if you then say to gemini, hey - would the answer be the same if it was ducks? it says NO then there would be 3 ducks and explains why.

Then if you say, but wouldn't the same logic apply to pineapples? It says 'oh yeah!'.

Anyone saying I am just playing with a silly thing, I say no - this is testing reasoning ability and understanding which is the number one thing I want.

ChatGPT appears to have a more generalised ability to reason whereas Gemini is only reciting its training data.

As a human, I think the correct answer is 7. This isn't so much a logic puzzle as an ambiguous sentence that can be parsed multiple ways.

yeah, as little as 3 at most infinity.

I mean, I thought and still think the answer is five… am I an AI or a human?

If the answer is so ambiguous that humans and AI get it wrong, is it really that great of a question?

The way I parsed that sentence, I came up with 5.

Hate to break it to you but I did too. Apparently that means we're both LLMs. I coulda sworn I had a whole childhood and everything but apparently I've always been a GPT.

This is less of a logic puzzle and more of a riddle. It would be a logic puzzle if the question was around the lines of "What is the least number of pineapples that satisfies these constraints?"

So close!

Reply on news.ycombinator.com