> Ha! A few gb ram and a few tb disk is real cheap in the cloud.

> If your dataset fits in ram, and when it doesn't you have to buy more boxes with more ram rather than just buying more disk, then I think you are making a very uneconomical trade off.

It is all in what lower latency is worth to the bottom line and how well you scale horizontally.