“One of my philosophies of building companies is the importance of velocity,”
True. And the key to keep (increasing) velocity is momentum. I believe the fundamentals to that is infrastructure. Once you get to the "flywheel stage" of an AI company (http://nicodjimenez.github.io/2018/01/25/stages.html), experimentation becomes so easy that new models can be rolled out nightly.