Acknowledging that you know you caused the problem has important social function: it provides sympathy to others who may be annoyed at you ("they are annoyed at themselves too, so I shouldn't be so hard on them") and signals that you are aware of your actions so are less likely to screw up in future.
But yes, you should clean up your messes.