If you have enough (V)RAM you can set up Ollama + any of the generation tools here (https://docs.openwebui.com/category/create--edit-images) and hook them into OpenWebUI to get something pretty close to what you'd get on a cloud AI chatbox.

Decently performing models for day to day use cases use at least 6GB VRAM each, though, and even then they're not coming very close to what the cheapest AI websites offer.

LM Studio solves for it pretty well I think. It doesn't do image gen etc though