A known known
465 karma · joined January 1, 2012
* pre-trained - train on lots of language modelling data (e.g. billions of words of wikipedia) and then train on the task you really care about but starting from the parameters learnt from the language modelling task.
- This will certainly be at least part of the future of education