> deep learning is simply the application of sequences of operations that are nonlinear but nonetheless differentiable

Though other things fit this description which are not deep learning. Like (shameless plug) my recent paper here https://ieeexplore.ieee.org/document/10497907