Planes are horrible without noise cancelling headphones for me, which incidentally solves the screaming kid problem too.
Removing them after a few minutes to talk to someone always feels like I am getting assaulted with noise.
Fell asleep for the first time on a plane and I'm never going back.