Every time I've seen people have the simplicity goal from the outset, they inevitably have to at some point abandon it or their simple software gets replaced by software that has additional complexity. It often happens that the complex replacement then again grows too complex, and someone comes along with a simpler solution and the cycle repeats indefinitely. Firefox was supposed to be a simpler Mozilla, and when it got too complex, Chrome came out. I wouldn't be surprised that now that both of them are too complex, in a few more years someone comes out with a browser that is simpler than both of them and is intended to replace them both.
Software development, in a very essentialist sense, is nothing but complexity management. Trying to never have any complexity is a naïve view of what software is.