Show HN: Cog – Docker for Machine Learning

Hello HN!

Cog lets you package machine learning models in a standard, production-ready container.

We built this to deploy models to Replicate[0], where it has been battle hardened with hundreds of models, but it can also be used to deploy models to your own infrastructure.

Andreas, my co-founder and one of the creators of Cog, used to work at Spotify. Spotify wanted to run models inside Docker containers, but Docker was too hard to use for most ML researchers. So, Andreas built a set of templates and scripts to help researchers deploy their own models.

This was mixed in with my experience working at Docker. I created Docker Compose, which makes Docker easier to use for dev environments. We were also joined by Zeke, who created OpenAPI (née Swagger), which is used to define a model’s inputs/outputs. And, many other contributors have since joined! https://github.com/replicate/cog#contributors-

It’s still early days, so expect a few rough edges, but it’s ready to use for deploying models. We’d love to hear what you think.

[0] https://replicate.com/