Reducing features to increase privacy, is this is good move?

In a world where there is growing concerns with what companies do with our data, is it better to have less features but to know you have kept control of your data? This might reduce possible features, but is it better to keep the user data local to you?