I'm a bit surprised that Soatto's and Tishby's papers aren't on the reading list (https://stats385.github.io/readings). I think they have some of the most interesting theories, at the moment, about why Deep Learning works.

https://arxiv.org/abs/1706.01350

https://openreview.net/pdf?id=ry_WPG-A-