I still can't believe that LLM encoders aren't unsupervised learned.

So much left on the table