I think the bigger hang up is that they're still slower and less capable than the frontier models, especially at the hardware specs most home users are likely to have.
I think the bigger hang up is that they're still slower and less capable than the frontier models, especially at the hardware specs most home users are likely to have.
If the first thing (for example) my mom sees upon installing the app is a dropdown model picker that contains things like "Qwen3.6-35b-a3b-mlx" she will 100% be bouncing off of it.
IMO the best version of this is a custom app/harness with a couple of pre-selected (and ideally fine-tuned) open models that immediately start downloading after checking the system's hardware specs. This would likely be a turn-off to most devs, but is absolutely essential if building an app for general consumers.
the current dielmma for me is how do I install a model on a remote LM Studio device without bypassing Lm Studio to SSH or remote in?
> lms link [servername] get model ?
> lms get [servername] model ?
> lms get model --link [servername] ?
Maybe I need to read the docs again but I swear the only way is remote or go to that device and download via the GUI, ssh in and use the local cli.
Maybe can copy/paste from one device's downloads dir to the server? Maybe I need to try hosting models on my NAS and see if I can download from device 1 then run on device 2 without install/setup?