Or by optimizing the code, switching to better algorithms, making better use of cache, etc.
"So, if the whole system is designed to Scale Out, one is in a relatively good position."
Not of the scale out overhead dominates the cost. A relatively recent, and widely read, article about this is at http://www.frankmcsherry.org/graph/scalability/cost/2015/01/... , titled 'Scalability! But at what COST?'. Quoting from it:
> Folks have gotten all wound-up about scalability, despite the fact that scalability is just a means to an end (performance, capacity). When we actually look at performance, the benefits the scalable systems bring start to look much more sketchy. We’d like that to change.