My professor told me learning is considered "deep" if your NN has more than two layers.