Current LLMs go crazy trying to handle "Are there primes whose digits sum to 9?"
twitter.com
twitter.com
Trying to help it towards the correct "no" answer seems to only drive it further into confusion. It's like the strong innate desire to provide a helpful example drives it to insanity instead of just saying that it doesn't know any valid solutions.