All the Activations (and a brief history of deep learning)

My cited and pdf linked notes on activation functions used in deep learning and their historical progression