A Recipe for Training Neural Networks by Andrej Karpathy

karpathy.github.io

IMO a great collection of advice. A must read for anyone planning to or already using neural networks in research or business applications.