130 karma · joined January 23, 2018
- ML models are often trained on very specific datasets and fail in embarrassing/costly ways when deployed in real-world settings where things looks different than the training data
- The worst part is that these limitations are usually not detected until the model is released, because usually the ML engineers may not realize that their model is: biased, unfair, or fragile
It takes a diverse team of users and testers to realize this. Gradio gives you the ability to instantly create a web interface around your model that you can share with a public link.
Your users or testers or collaborators can (right from their browsers, without having to install any software) try your model, understand its limitations, and point out biases in the model and data.
To a certain extent, saliency maps can be perturbed even with random noise, but the more dramatic attacks (and certainly the targeted attacks, in which we move the saliency map from one region of the image to a specified another region of the image) require carefully-crafted adversarial perturbations.
The goal of this notebook is to provide some basic intuition of deep neural networks by running very simple experiments on small datasets that help understand trends that occur generally on larger datasets. The experiments are designed to be "atomic" in that they try to test one fundamental aspect of deep learning in a controlled way. Furthermore, the experiments do not require specialized hardware (they all run in a few minutes without GPUs. See the elapsed time, measured on a CPU-only machine).