Great interview. I have been trying to understand how the success of deep learning will affect my career (I started using neural networks in the 1980s: DARPA projects, commercial projects, etc., but now less that 1/2 of my professional time is spent doing deep learning and General machine learning). I am trying to decide whether to toatally jump back into the field to take advantage of a lot of practical work experience, or keep doing general consulting. I am concerned that the field of deep learning is saturated right now.
One small nit-pick about the comment "a young child can see a chicken once, and if you then ask them to draw a chicken, they’ll typically be able to. The child has a representation of a chicken from one sighting, and is able to abstract that into a drawing." This hypothetical child watches the chicken, moves his head for a little different view, the chicken is probably moving, etc. There is a lot of training data collected by the child.