> It's understanding something, even if it's not the job skills

It's no better than any other evidence of effort

> Can you imagine someone who performs well at these kinds of challenges being a bad hire?

I don't have to imagine; it tends to lead to hard-to-maintain 'clever' code, with little ability to deal with less-than-clear requirements.