It makes perfect sense and is a well-known legal saying.

Edit: apparently it may be attributable to William Penn, of Pennsylvania fame.