Want something removed? Create a definition of when you should activley remove something. Like this:
Candidates for feature removal of (SYSTEM)
* Does not impact how the application can be used
* Requires manual testing
* Is greater than 1% of the size of the application, or greater than 500 lines of code
If X meets all three candidates it's up for removal. Any bug created can be referred directly to this list.
There. You don't have to come out and say "We're terribly sorry, but unfortunately we've decided to remove this feature because of blah blah blah" and you don't have to just say "No.". Instead you can say "Removal decision is based on (INSERT LINK TO ABOVE), if you disagree (INSERT ACTION TO CHALLENGE)".
What people want is something that gives the impression of a uniform set of decisions. They don't want to feel that people/developers are just being petty dictators.