Another fantastic (and free!) Information Theory resource is David MacKay’s book, which also addresses aspects of Bayesian Statistics and Machine Learning: http://www.inference.org.uk/mackay/itila/

It’s among my favourite textbooks: you can feel his enthusiasm and personality through the pages. The world is a poorer place without him around.