Most humans fail this, in my experience.
I'm not sure a trick question is going to be the litmus test for AGI.
I'm not sure a trick question is going to be the litmus test for AGI.
Reread carefully: the question compares "a kilogram of feathers or a kilogram of feathers".
I've never heard that one before but my brain pattern matched right over to "a kilogram of feathers or a kilogram of steel" and moved on. I had to read it 3 times before I got the subtlety.
It's meant to appear as the often used trick question comparing different densities of materials but OP says feathers twice.
The trick is that an LLM will add in a dense material to the answer because it's only ever seen the question asked that way.
And even if it was a typo and I meant to say rocks, the model will often assume a variety of metals and answer with those.