Let me drop in a plug for my favourite book, William Gary Flake’s The Computational Beauty of Nature (1997), by far the best exploration of these kinds of concepts I have ever encountered. It’s rich in discussion, beautiful diagrams, formulae & equations, and even compilable code—kind of like Stephen Wolfram’s A New Kind of Science (2003) but without the bombast and done right.