> that there is discernible structure built into the weights

Yes, this "structure" is but the weights of the glorified logistic regression that's describing an extremely simple statistical process.