The insecurity is strong with this one. You're projecting that the person's literary references are "name dropping things in largely irrelevant contexts". There is no basis for this assumption, other than your obvious bias to jump to the conclusion that this person is elitist and goes out of their way to seem elitist. Why? Are you sensitive that you didn't get into a school like MIT? Neither did I, but nothing he is saying comes across as even remotely elitist to me.
You're really just coming across as a jerk.