> For me it's too much of a coincidence that the two most generally intelligent systems (ANNs and BNNs) are both "linear networks of activation functions".

I am unconvinced that "linear network" appropriately defines BNNs. Can you clarify this?