Single point of failure doesn’t mean “weakest link”. It means if this one piece (“single point”) fails, the whole system will fail.
Contrast a second chain, or double linked chain, so if any link fails the load is not lost.
If you know the strength of every link in the chain with perfect accuracy, and you know that the only potential cause of failure is too much weight being placed on the chain, then the only link that can fail is the weakest[1] one because no other failure can happen before that one.
But really you need to design for the idea that various things might happen. Someone else gave the example of a person choosing a link to cut with bolt cutters. The person's choice is what's not predictable in that example.
---
[1] And if you assume it's not possible to have two links that are exactly as strong as each other.
Which isn't relevant since (obviously) no one was talking about how many links are the weakest link.
"it is at that link where the chain will break"
Wars have been lost by thinking this way. e.g., D-Day was a successful assault on a strong link.