The fundamentals of Information Theory via (the late) David Mackay's lectures and textbook (homepage with links to the videos and free online textbook here: http://www.inference.org.uk/itprnn/).