It must feel similar to those who wanted to become chess or go masters after computers surpassed humanity in those games.
This is somewhat misleading, the LLMs' contributions are in a limited niche of highly technical problem solving. They're neat but they're not the first mathematical theorem that gets automatically solved by a computer, that was done already in the 1990s.
> Maybe by using LLMs as a mighty tool and providing skilled usage and oversight?
Yes, even in the areas where LLMs are at their best, we'll still need a lot of human effort to make the results cleanly understandable. LLMs cannot do this well, even their generated papers have to be rewritten by human experts to surface the important bits.
The can't predict the consequences of an action predicting one token after another. They can't solve a Rubik's Cube unlike a 7 year old human who can learn to do it in a weekend. They can't imagine the perspective of being a human being unlike a 7 year old human if asked to imagine they where in the position of another human.
Can you imagine what if feels like to be a LLM?
Can one LLM have a better sensation of what it feels like to be a different LLM (say one that score a little better?)?
You design circularly defined criteria...
or even just take a picture of the thing, since they can digest visual input now
On the other hand, in the very long run, what does it mean if a talented human being does not have enough years of life to fully analyze and understand an extremely advanced proof created by AI?
[0]: https://slatestarcodex.com/2017/11/09/ars-longa-vita-brevis/
The most recent advances are stunts by a handful of famous prompters who are funded in various ways by the LLM industrial complex.
How many theorems are proven by mathematicians each year? Let's guess 10000. Then the Erdos toy proofs with unknown token and resource usage are less than 1%.
Ironically, there is a shoe company pivoting to AI. My taxi driver told me buy the stock: