ParentFull threadlittlemtman·RELU is really good for mostly positive weights. ELU is good for bothView on HN