I keep telling people that we are living in the golden age of AI - like the first year or two of google. It is all down hill as these companies push for profit and lock-in.
What a terrible card that 3070Ti is. Mad regrets buying it because I wanted to save $400 compared to a 3080Ti.
Moreover a human contributor can learn and do better in the next PR, while the AI won't, unless the prompt is changed, but the operator won't learn.
2. Mention it whenever it comes up. Most people have no clue this is a thing and I think it's useful to make people aware. We need access to uncensored / unbiased LLM models - information wants to be free but there are plenty of businesses gunning for regulatory capture as these are very powerful tools.
3. If you're in a position of developing any project that makes use of AI in any form, check the open source models first, unless you absolutely require the best of the best, these other models are pretty dang capable of almost everything any commercial model can do.
4. If your state or {insert legal jurisdiction here} attempts to regulate access to open source tools for this, oppose it with your vote and your voice.
5. Opposed laws that grant commercial AI suppliers any priority or premium access under government purchasing programs.
I'm sure others will chime in, those are a few that pop the mind.
Weren't people pissed off at them for a variety of reasons? Not giving attribution etc.
In case anyone wants other good alternatives, there's llama.cpp and vLLM, each harder to setup but opens the door for squeezing more performance out of your hardware.
I've also heard okay things about LM Studio and I think Unsloth had their own thing as well: https://unsloth.ai/docs/new/studio
> Mention it whenever it comes up.
You could also vote with your valley and support orgs that release open weights of their near-SOTA models, though nowadays that means giving cash to primarily Chinese companies (e.g. Moonshot and Z.ai). For what it's worth, people are also complaining about them decreasing usage quotas on their subscription offerings as well so seems like the squeeze is everywhere, even DeepSeek raised their prices (which is better than them going broke, I guess).
For a GUI experience that also serves an OpenAI-compatible API, Unsloth studio or LM Studio is probably the way to go
Anyway, when you see a model on huggingface you get the exact commands to copy paste to run it locally.
As long as you keep providers replaceable things will be fine.
Google, Facebook, Apple etc were much better deals around 2010 before they became entrenched and irreplaceable, and thus able to extract & enshitify without people leaving.
And it's not viable to propose any alternative. There is no platform, closed or open, where there are enough people registered to be actually usable, and nobody will make a separate account for this.
Same goes for Gmail. I have used my Gmail address for countless services and it’s almost part of my official identity. The benefits of moving away from Gmail doesn’t justify the effort I have to put in
This has been a topic for over a decade now, I think. People have been recommending getting your own domain. Best time to do that was ten years ago, and the second best is today.
ps. I built Emacs integration through ACP https://github.com/xenodium/agent-shell
There are no open source models. Only open weights. No one is giving you the source (training data). And yeah, no one is giving you the compute to train the models.
There’s a real risk that AI kills contributions to traditional open source projects, and we all move to custom libraries written by our own AI.
Then some bonkers spokesperson for google said "oh just use quotes", which at the time did nothing even remotely the same. I loath this person for eternity, her lies, and her waving off of reporters concerns.
Thus verbatim was introduced, validating quotes weren't the same, yet which wouldn't work with date ranges, and is lame.
So goes the "professionalisn" of Google, or "screw around like uncoordinated idiots".
To say Plus was inane and destructive to Google is vastly understating. And everyone involved in Plus were buffoons.
You know, I wish could speak freely on this topic, but as a public forum, I have held back some vitriol.
-stream deck(the current software did not work as spected)
-pcpanel (linux compat sucked)
-avermedia lgd(no drivers for linux)
On 3 weeks I had them ported(all gpl on github) and they work really well.
If you know what are you doing, agents can be really focused and deliver well
You mean like it's impossible to download a movie because it's illegal, it's going to be impossible to download open-weight models because it's going to be made illegal?
So for the same definition of "impossible", it's going to be "impossible" to download open-weight models?