Not true. You can easily train a BERT single class classification model without having to train an LLM.