Came here to add Strang's. In the same spirit of Jaynes', a very good exposition for self-study students.

In logic, "Introduction to Logic: and to the Methodology of Deductive Sciences" - Tarski.

I wish that I started studying these three books before college, in order: 1) Tarski's 2) Strang's 3) Jaynes'