By asking for books that affected science itself you set the bar pretty high. Here are some of my favorite popular science books that I think are all noteworthy enough to have been discussed by scientists.
- Godel, Escher, Bach: an eternal braid - Douglas R. Hofstadter
- The Emperor's New Mind - Roger Penrose
- The Embodied Mind - Varela, Thompson & Rosch
- Don't sleep, there are snakes - Daniel Everett