how does one do that from their comfy chair?
ps. I built Emacs integration through ACP https://github.com/xenodium/agent-shell
2. Mention it whenever it comes up. Most people have no clue this is a thing and I think it's useful to make people aware. We need access to uncensored / unbiased LLM models - information wants to be free but there are plenty of businesses gunning for regulatory capture as these are very powerful tools.
3. If you're in a position of developing any project that makes use of AI in any form, check the open source models first, unless you absolutely require the best of the best, these other models are pretty dang capable of almost everything any commercial model can do.
4. If your state or {insert legal jurisdiction here} attempts to regulate access to open source tools for this, oppose it with your vote and your voice.
5. Opposed laws that grant commercial AI suppliers any priority or premium access under government purchasing programs.
I'm sure others will chime in, those are a few that pop the mind.
Weren't people pissed off at them for a variety of reasons? Not giving attribution etc.
In case anyone wants other good alternatives, there's llama.cpp and vLLM, each harder to setup but opens the door for squeezing more performance out of your hardware.
I've also heard okay things about LM Studio and I think Unsloth had their own thing as well: https://unsloth.ai/docs/new/studio
> Mention it whenever it comes up.
You could also vote with your valley and support orgs that release open weights of their near-SOTA models, though nowadays that means giving cash to primarily Chinese companies (e.g. Moonshot and Z.ai). For what it's worth, people are also complaining about them decreasing usage quotas on their subscription offerings as well so seems like the squeeze is everywhere, even DeepSeek raised their prices (which is better than them going broke, I guess).
For a GUI experience that also serves an OpenAI-compatible API, Unsloth studio or LM Studio is probably the way to go
Anyway, when you see a model on huggingface you get the exact commands to copy paste to run it locally.
As long as you keep providers replaceable things will be fine.
Google, Facebook, Apple etc were much better deals around 2010 before they became entrenched and irreplaceable, and thus able to extract & enshitify without people leaving.
And it's not viable to propose any alternative. There is no platform, closed or open, where there are enough people registered to be actually usable, and nobody will make a separate account for this.
Same goes for Gmail. I have used my Gmail address for countless services and it’s almost part of my official identity. The benefits of moving away from Gmail doesn’t justify the effort I have to put in
This has been a topic for over a decade now, I think. People have been recommending getting your own domain. Best time to do that was ten years ago, and the second best is today.
Moreover a human contributor can learn and do better in the next PR, while the AI won't, unless the prompt is changed, but the operator won't learn.
What a terrible card that 3070Ti is. Mad regrets buying it because I wanted to save $400 compared to a 3080Ti.