As a cautionary tale -- make sure that there is fundamental institutional support for the removal of said garbage. If cleaning up the garbage requires help from someone else within the institution, verify that they can and will help you before you begin.
Source: I volunteered to remove some challenging/delicate garbage without sufficient institutional support. The lost productivity has had a marked impact on both my career and our team's success.