How Smart Is Bert? Evaluating the Language Model’s Commonsense Knowledge

BERT makes use of commonsense knowledge when solving CommonsenseQA questions and that fine-tuning can further enable BERT to learn to use its commonsense knowledge on higher levels.