You might enjoy Oliver Sacks' book Musicophilia: Tales of Music and the Brain. You're not alone in your experience.