I understand how the principle works, in part because of this wikipedia article, but what I don't understand is why such a rule has been implemented.
It protects the population at large from an unrestrained law enforcement system from intruding upon you in a multitude of ways.
Perhaps there need to be. Perhaps consequences much more severe than letting a criminal walk free.