Show HN: Inferrd – Heroku for Machine Learning

Hey, Lucas here. I’m excited to share Inferrd along with my co-founder Theo. It’s a product we started working on after dealing with our fair share of deploying models on GPU in traditional clouds (GCP, AWS, Azure) for consulting contracts.

Hosting AI is challenging because it requires GPUs and most of the time, data scientists are left to design and build the infrastructure. Configuring Nvidia and Cuda is another issue that can consume days or weeks (add a few more weeks for TensorRT).

That’s why we built Inferrd, it’s a Heroku-style GPU hosting platform specifically designed for AI models. All the libraries are pre-configured, no cold start and out-of-the-box support for most major frameworks (spaCy, TensorFlow, PyTorch, Keras, Scikit, XGBoost). In addition, we leverage GPU sharing to provide very competitive pricing. Lastly, we provide key authentication, smooth scaling and monitoring tools.

AI hosting is a very interesting new space, and we’ll be around to answer any questions!