Privilege is nothing more than a social factor to be aware of, both for the haver of privilege whose perspectives might be warped by their experiences, and for the social systems (like the justice system, mentioned in the article) who at least in theory are trying to be objective about things.
Don't take it so personally. Privilege doesn't make you a bad person, and raising awareness of it is a good thing.