I think in many cases a good minimalist framework will get a core set of functions out of the way (in web for example: routing, autoloading, dependency injection, etc.). Grabbing something small that provides a proven but efficient backbone can let you focus on delivering core value, but then can easily be switched out later as the solution grows.