One big reason to use Marathon + Chronos + Mesos is to get multi-tenancy of compute and data workloads on your instances. You can't get that with web-service specific tech like Tutum.
[1] appuri.com
You can make an account and boot apache Spark in about 30 seconds using this link [0]. It's running in production right now for a lot of people, and you can run Mesos on top of Terminal if you want it [1].
Again, I'm not trying to push this on you if you're happy with how stuff works today, but I think we've made a PaaS that solves a lot of these problems (and we'll let you run it on your own metal too if you want it). Check it out at terminal.com if you have some free time.
[0]https://www.terminal.com/snapshot/c81e6215eba5799335a45b6936... [1]https://www.terminal.com/snapshot/44d4ee043422afec75dfd3bdaa...
It's kinda cool, or at least I think so.
Even Exhibitor is not a silver bullet for managing ZK. It helps with rolling restarts and lets you do a sort of MySQL-esque bin-log replay of your state, but even with Exhibitor, it's not going to make for a smooth recovery at 4:00AM when PagerDuty rings.
The underlying design of how Mesos and Marathon communicate create situations where they have differing views of the state of the cluster, and you end up with "orphans" which are tasks that Mesos is aware of but Marathon knows nothing about.
In my opinion, the system feels like it was designed to be something else, and then all this functionality was tacked on later. Coincidentally that is exactly what the case is with Mesos. I think there is a lot of room for an improved user experience that these tools will struggle to provide.
There's a big naming and marketing confusion at the moment with the open-source project and the VC-funded startup having such a similar name. It's unfortunately giving a bad reputation to the Mesos project.
Curious why there actually isn't a trademark issue here...?
Twitter engineering recently blogged about Aurora with a bit more on its history: https://blog.twitter.com/2015/all-about-apache-aurora, and The New Stack recently published a two-part article on the project: http://thenewstack.io/twitters-aurora-relates-googles-borg-p..., http://thenewstack.io/twitters-aurora-replaces-operating-sys...
(full disclosure, I work at the tweet shop)