Good to know, thanks. What do people generally use to connect to it for chat?
Msty (msty.app). Currently they're working on Msty Studio which is only accessible to people with a license, but the desktop app is pretty good, it just doesn't have tool (MCP) support.
Doesn't Msty alreayd run models? What is LM Studio needed for in this setup?
OpenWebUI seems to be the standard. Easy to spin it up in a docker container pointed to 127.0.0.1:1234/v1 and away you go.