Unjustly blaming and punishing someone is defamation and aggression. You don't need extra rights to be protected from that.
How about you read declarations of rights to a fair trial and point out where they imply that they are principally about ensuring the accusers' application of aggression is justified, as opposed to protecting the accused?
Whether or not you think an "extra right" is necessary has no bearing on why that right is provided.