Besides the obvious difference in opinion about what constitutes "common", "good", or "the common good"?

Those whose justification is "the common good" are often those who hate them and wish to see them destroyed. One can't blame them for not wanting to consort with such undesirables.