I'm a one-man startup and I couldn't disagree with this more.
If you want to "play" startup, feel free to put all your eggs in one basket. If you actually want to build something meaningful and long-lasting, and you have Fortune 500 customers, take a breath and invest time in an infrastructure that can't be destroyed by a single rogue algorithm.
After all of the horror stories we've heard over the years, how is that time investment (and ability to sleep well at night) not worth it?