+1 for Information Theory, Inference, and Learning Algorithms. A fantastic book by the late David C Mackay. Part V has an interesting presentation of neural networks, but really this book is about information theory and Bayesian probability.

http://www.inference.phy.cam.ac.uk/itila/