The point is the Anti-Federalists said "No Bill of Rights, we won't observe the Constitution." Starting with New York I think this was made an explicit contingent condition of their ratification of the Constitution. Thus a compact, or covenant if you prefer.

Thus the Bill of Rights are special in a way no other Amendments are and cannot be abrogated without breaking the covenant that allowed the Constitution to become a thing in the first place.