For ideas - remove ideas by banning / censorship, or add ideas by promoting 'better' ideas - this seems like a possible avenue to improving society's mental health. The main objection is whoever controls what to ban / allow is given a lot of power, so how do we decide these things.
For people - I think it's fine to be intolerant individually, however our institutions should not be intolerant. For example I can hire a cleaner for my house and refuse certain people. However it should not be possible for a company to refuse certain people as cleaners. I'm not sure how to formalize this into a law though.
Physical or mental violence because of intolerance of people and ideas are bad because I don't want violence on me. However I am not certain how to define mental violence.