No, freedom of speech really does imply some protections, such as not getting instantly fired or jailed for your opinions.
As another commenter pointed out, the fact we are having a debate on the subject is the correct way to resolve this situation and decide if RMS should continue to represent the FSF. The larger issue is a tiny minority have decided it is unacceptable to have this conversation and he must go ASAP.