A custom email sorter / spam filter that uses a fineruned multimodal LLM: my emails are turned into images (turning them / extracting html then rendered with selenium) and passes to the vision LLM. I went from ~200 to ~15 useful emails a day.

Raw code is here: https://gitHub.com/beniz/llmbox

All runs locally, the finetune is a plaigemma-3b (from mix-448). Acc/F1/prec/recall are all within 99.99%, including on llm-generated spam.