_Introduction to Information Theory: Symbols, Signals and Noise (Dover Books on Mathematics)_ by Pierce is another such book.

It is of course only an introduction to the field, but it had an immense impact on how I saw information (hence, the universe) after I read. Primarily because it showed to me the many faces of Information Theory- music, psychology, geometry, language, cybernetics, etc.