Tolerating people who may not tolerate you allows you to raise above the situation. If you are tolerate to any idea and you see a red ball and Jim says the ball is yellow that doesn't change your opinion on the color. It allows you to maintain your viewpoint and allow others that may be different and incorrect in your view. Not allowing that would mean trying to convince Jim he is wrong or removing Jim from my circle.
Can't we let people hold views we deem incorrect ourselves?