I’m Daniel from the Efemarai team here. Svet and I are a couple of founders with deep tech backgrounds who have spent endless hours testing and debugging ML models. During our PhDs AI & Robotics and professional work later on, we’ve struggled with the limited QA techniques and tools for ML that are out there. That’s why we’ve ended up creating Efemarai - a platform for testing and debugging ML models. With Efemarai you can easily visualize your models and data but also specify all sorts of assertions to be automatically checked. It’s really easy to set up and takes literally 2 lines to integrate it with your codebase (`import efemarai as ef` & `with ef.scan():`) and look in your browser for results. If you don’t have any code lying around, don’t worry, after signing up you’ll get a short demo to show you how to navigate around and some of the features. Right now you can:
- Inspect and see any tensor!
- Show the full computational graph - next time you `git clone` an ML model, get a look at what you get. - During training, get aggregate information about any tensor or gradient. See what causes them to explode or vanish to zero.
- Automatically catch some common issues or write your own checks.
- Write custom system or browser notifications to get your attention back to training when issues happen. We all try to multitask during model training.
We’ve built Efemarai for developers and with privacy as a top priority, so none of your data or models leave your machine. You’ll be able to show quite large, multi-stage models like DCGAN, but also build and dissect your own (http://bit.ly/3eqZKbf).
We are now looking into enabling users to share their model visualizations online, what do you think? Are we missing something that you’d love to have to make your ML model testing or debugging easier? How do you test for regressions in your ML development?
Check out Efemarai on Product Hunt as well - https://www.producthunt.com/posts/efemarai