You're right, but there's a sliding scale of rights, which can't be better demonstrated better than in 1A law. The way that the scale, and many other gray areas of rights, is determined, is greatly influenced by morality.