So then you're saying reality can't have a logical contradiction? Seems like you're agreeing with the original statement.
>Even a totally random universe follows some kind of distribution
Which is just a kind of rule.
He's assuming a mathematical model that faithfully represents reality, hence "reality can't contain contradictions". We're not going to one day find a contradiction and vanish in a puff of logic, the ultimate model of reality will be contradiction-free.
>So reality works because math works.
Reality is that the one that contains the structures not math. So what you said does not make sense.
But math contains all physically realizable structure, i.e. all structure that can represent some feature of reality. But also structure that cannot be realized in reality, e.g. sets too big to fit in reality. That one can deduce some logical structure from observing reality isn't the deciding factor here.