The Cloud is not a silver bullet.
blog.kevburnsjr.com
blog.kevburnsjr.com
Finding that tipping point requires that you have a very clear understanding of your company's use-case, which is unlikely to be true when starting out. I often recommend that startups go down the cloud route while still exploring, while keeping a close eye on the costs, and having a clear set of migration criteria and plans.