It can use self hosted LLMs, I don't have good enough hardware to serve any meaningful models though.