Give people choice: People who like it old way are still happy and people who like new stuff will just switch.

Make a dialog at the start of the session when you release new features, asking if you'd like to enable new features or keep your old settings for existing users. Install new features on by default. Everyone happy, no complaints.

Then collect stats after some time and see what is actually getting used and if 95% is in favor of some option - remove the old feature.

This could also be a nice incentive to provide stats to developers - your opinion gets counted.