We've all what a terrible job LLMs do in some problems. But they are doing well at burning down Erdos's list of problems. Perhaps mathematicians aren't a good measure of "truly smart".