Hahahaha, I think you’ve misunderstood what LLMs are.
But just so we're both entirely clear on what an LLM is... it's a token prediction system.
it genuinely can't do things except recall things that have already existed.
People are having great success composing things together in new ways, but just like the english language has a finite number of sentences, and music has a finite number of chords: LLMs too are just combining things that have existed.
I don't want to sound condescending, it is remarkable how useful this technology is, but please don't evangelise them on capabilities that they genuinely can never have.
Laptop computers have incredible processing capabilities but nobody expects them to be able to walk your dog, no matter how useful they actually are at doing other things.
Knowing how hard something will be to do before attempting it is precisely the sort of impossible thing that it couldn’t do.
a) if something is possible
b) if something has been requested to take a long time ( a signal of abuse, like requesting illicit pictures in image generation)
is actually somewhat straightforward (I mean, if they are able to predict if something is a “substantial piece of work” as they seem to do already).
The mathematical proof thing is obviously marketing spin, you should pay more attention to what mathematicians are actually saying instead of hackernews folks.
These things are really good at being search engines and harnesses for iteration rather than some kind of advancing intelligence.
https://cacm.acm.org/research/formal-reasoning-meets-llms-to...