That is the point of the paper: making deep fully-connected networks work.