From Confidently Incorrect Models to Humble Ensembles

Can't you create an other class and get it to learn to classify it as other?