Comment by Kuinox | Hacker News Reader

Comment by Kuinox | Hacker News Reader

Parent Full thread

I'm saying the author just showed it have a bad eyesight, then said it's thinking ability is low because it can't do sums, if you reformulate the exercise in a way it can ingest, and something that make sense for how it understand data, it can complete the exercises:

Here with my prompt:

    xoo
    ooo
    ooo

    oxo
    ooo
    ooo

    oox
    ooo
    ooo

    ooo
    xoo
    ooo

    ooo
    oxo 
    ooo

    ooo
    oox
    ooo

    ooo
    ooo
    xoo

    ooo
    ooo
    oxo

    ???
    ???
    ???

    What the "???" should be ?  

    Answer A:
    ooo
    ooo
    oox

    Answer B:
    ooo
    ooo
    xoo

    Answer C:
    ooo
    ooo
    oxo

    Answer D:
    ooo
    oox
    ooo

    Answer E:
    oxo
    ooo
    ooo

    Answer F:
    ooo
    oxo
    ooo

Mistral Large:

> Based on the pattern, it appears that the "x" is moving one step to the right in each row, then moving down to the next row and starting again from the leftmost position. Given this, the "???" should be:

ooo ooo oox

So, the correct answer is A.

Edit: note it doesn't always respond correctly. I ran it 10 times on mistral large, and it responded correctly 8 times. In the two time it failed, it correctly describe what the final sequence is, but it selected the incorrect response.

fwiw: Gemini gets this wrong!

   The answer is most likely Answer B: ooo  ooo  xoo.

   Here's why:

   The pattern repeats every three rows.
   The first three rows establish a pattern of "x" alternating between the first 
   and third columns. "o" fills the remaining spaces.
   Looking at the last two sets of three rows, we see ooo xoo ooo followed by 
   ooo ooo oxo.
   Following the established pattern, the next set of three rows should be ooo 
   ooo xoo, completing the cycle.
   While other answers might fit in a single instance, they wouldn't maintain 
   the consistent pattern throughout the entire sequence.

I canceled my ChatGPT subscription recently and I can't test it on on GPT4 either. Mistral Large should be inferior to GPT4 according to mistral own benchmark. Also, look at my edit, don't run it only once, LLMs arent infered deterministically and it can give you a wrong response even if it respond correctly 80% of the times.

I tried GPT-4 with my modified prompt (see https://news.ycombinator.com/item?id=39583414). Here's the response:

The patterns provided show a progressive movement of "x" in a clockwise direction starting from the top-left corner, moving to the middle of the top row, then to the top-right corner, descending down to the middle of the right column, moving further down to the bottom-right corner, then to the middle of the bottom row, and finally to the bottom-left corner.

Following this sequence, the "x" would move to the middle of the left column after the bottom-left corner, which is represented by:

  o 
  x
  o

However, none of the provided answer choices directly match this progression, as they all consist of 3x3 grids with "x" in various positions. Given the pattern's progression, after reaching the bottom-left position, the next logical step would be to move back to the initial position or follow the pattern as closely as possible within the provided options.

Since the last illustrated pattern before the question marks is:

  ooo
  ooo
  oxo

The correct substitution that follows this clockwise movement would be to place "x" back at the top-left corner, as the cycle restarts. However, this direct option isn't provided. The closest next step according to the given pattern progression would actually be placing "x" in the bottom-right corner to continue the clockwise motion:

  ooo
  ooo
  oox

Thus, the correct substitution for the last pattern with the given options would be:

Answer A:

  ooo
  ooo
  oox

This choice follows the logical progression of the pattern as "x" moves clockwise around the perimeter of the 3x3 grid.

Gemini Advanced got it right on the second attempt. On the first attempt it mistakenly thought that the problem was a tic-tac-toe game, but after I told it that it was an IQ test I got the correct answer.

I also changed the wording of the prompt slightly:

Here are some patterns:

...

Which of the follwing answers shows the correct substitution for the last pattern (the one with the ???)?

...

Reply on news.ycombinator.com