I never got this idea that taking notes distracts you from listening. To me, it forces you to pay attention so you know how to organize what you write (especially in math, where I usually rewrote some proofs on the fly so they were less ambiguous and more easy to check for correctness later).