This isn't a problem of the ivy leagues (or any college, the one I attend included). The problem is that society makes everyone think that they're the best at everything. Thinking "I couldn't possibly have anything to talk about with this 'common man'" is just an extension of this arrogance.

People don't unlearn to relate to people in good Colleges, they just never knew in the first place.

Edited to add: LOTS (if not most) of people at 'elite' Colleges know how to relate to 'average' people.