I agree that less is often more. It's better to do a few things well than to do many things poorly, the latter being an inevitable result of feature creep and design by committee.
That said, I tend to hold to the MIT Approach: correctness and consistency should not be compromised.
It sort of feels like an extension or parallel to "Perfect is the enemy of good."