745 karma · joined September 7, 2023
Yes, Asahi exists, and props to the developers, but I don't think I'm alone in being unwilling to buy hardware from a manufacturer who obviously is not interested in supporting open operating systems
I mainly use them for deep work with texts and deep research. My main criterion is privacy, both for legal reasons (I'm in the EU and can't and don't want to expose customer's data to non-gdpr-compliant services) and wouldn't use US services personally either, e.g. I would never explore health related topics chatgpt or gemini for obvious reasons.
Technically I've set it up in my office with llama.cpp and have exposed that (both chat interface and openai compatible api) with a simple wireguard tunnel behind nginx and http auth. Now I can use it everywhere. It's a small, quiet and pretty fast machine (compiling llama.cpp is around 20 seconds?), I quite like it.
Personally I'm not interested in having a mac as I work with linux. And yes, they outperform them, but only if you ignore the price. When comparing what you get for ~$2k, a Strix Halo is miles ahead.
The obvious solution for better health for all would be providing public and freely accessible locations for getting these shots, or mobile teams providing them at schools etc.
This wouldn't mean this type of content would disappear - for every single business producing such content there's a bunch of people doing the same for free. And then there's patreon et al., and funding for education etc.
To be clear: The models are open weights everyone can simply download, because many labs publish them as such. The providers in question are generic hosters. It's the same as if you would get some managed wordpress hosting somewhere.
llama.cpp is the actual engine running the llms, ollama is a wrapper around it.
If remote models are ok you could have a look at MiniMax M2.1 (minimax.io) or GLM from z.ai or Qwen3 Coder. You should be able to use all of these with your local openai app.
But much of the electronics industry in the EU is B2B and centers around producing high-margin products where 10.000 units of a product would be huge.
The company I work for, for example, usually produces a few hundred units of a product before the next revision replaces it. Whether or not the PCB costs 20€ more or not really isn't that important if you only plan to sell 100 devices of it per year for 10k€ each. Aspects like quality and regulatory conformity are way more important here.
Again, the root problem of course is that there is any data to share in the first place.
But answering as a hypthetical roomba owner: As I am from the EU, this new ownership would actually be better for me. The US already mandates spying with devices like these, and has been caught multiple times doing so already. It is also known to share info with the domestic services, the latter point not being true for China.