Facebook does not face outrage for "literally remov[ing] anything". In the real world, Facebook is removing thousands of items every day, maybe tens of thousands. Most of them are totally justified. Is HN outraged about that?
Also, keep vs. remove is a false dilemma. Facebook has many more options than keeping or removing items. Most of the time, it's about what they choose to boost or reward in other ways. https://twitter.com/BKCHarvard/status/1263891198068039680
That said, I think you're right that being an effective arbiter on planetary speech is a difficult place to be, even for people with the best intentions, and FB didn't get where they are today by having the best intentions all the time.
But personally, I think that calls into question whether Facebook or anything like them should even exist.