My experience is the opposite.
The simplest solution is harder and takes longer.
I think easiest or quickest is what is really meant in this formulation, but rarely do either of these result in simplest. I start with the former and strive to iterate towards the latter, because the former starts cheaper but ends up more expensive in the long run.
Simplification is an optimization.