Introduction to Information Theory

I have seen a fair number of submissions regarding information theory on Hacker News.

Here are my personal favorite resources: 1. "A Diary on Information Theory" by Alfred Renyi: https://www.goodreads.com/book/show/4962977-a-diary-on-infor... . Written in a very charming manner (dialog between teacher and student) and is accessible to a wide audience. 2. Some lecture notes on information theory: http://people.lids.mit.edu/yp/homepage/data/itlectures_v5.pd... . Much more mathematically demanding, but is quite comprehensive, and a modern account of the subject.