This is a sort of tenant of the modern state if you look at it a certain way. Ultimately the threat of violence is invested in the state to ensure the law is followed.
It is not a pitchfork and torch mob that should come after you should you appear to have committed a serious crime, but rather the government's police agencies that will come to arrest you, very physically if need be.