The "social contract" is a religious non-proven abstraction. There was never any social contract anywhere. And even if there was, it does not bind you or me in any way. And even if it could, we could impose our own versions of a social contract on each other making it irrelevant.
The consensus on social norms is not a consensus if it's enforced by some group on another - that's just bullying, not agreement. If our ideas of how society should function differ, we can either reach some compromise to mutual satisfaction (==consensus) or start fighting and guy with 51% of power will win. But that wouldn't be a "contract", "consensus" or "morality" in it. It'll be just an outcome of a brutal conflict.