True, it goes against the spirit of deep learning

Still the Transframer results are interesting and has encouraged me to look into it