Terry even says this: "In fact, it is now the identification of a promising problem which is the scarce and precious resource."
The creativity and insight needed to ask a question that Terry gets excited about is the next step. Perhaps OpenAI should create a set of challenging questions and offer a prize to solve them.
It's a marketing game for them, any societal benefits are secondary. Winning a prize is going to get headlines and feed into the "AGI soon, machine replaces another career" narrative they crave unlike coming up with some (possibly) interesting problems.
For anyone facing an existential crisis on AI, your ace in the hole is your humanity. Only you have it, and only you will be the best judge of what is good and interesting (to a human at least).
Average HN Poster: [nervous sweating]
My humanity is not paying my bills.
As far as I can tell, it's still not possible for an agent to reliably determine if a question is a good question. That means the test part of the loop cant be fulfilled.