> turns out solving a Millennium problem doesn’t require any thought at all

This, but unironically. We know they can't think. That is inherent to the very way they work, but also can be seen by things like how poorly they perform on tasks a typical human can do pretty effectively (because humans have actual reasoning ability).

If we have a machine that we know for a fact can't think, and it solves a particular problem, then it logically follows that the problem does not require the ability to think in order to solve it.