tedivm

Storing on GPU would be the absolute dumbest thing they could do. Locking up the GPU memory for a full hour while waiting for someone else to make a request would result in essentially no GPU memory being available pretty rapidly. This type of caching is available from the cloud providers as well, and it isn't tied to a single session or GPU.

That cost that you're talking about doesn't change based on how long the session is idle. No matter what happens they're storing that state and bring it back at some point, the only difference is how long it's stored out of GPU between requests.

You can send books to your kindle over USB, and I do that all the time for larger books that are above the size limit on the email system.

The big problem is that Amazon no longer allows you to download books from their site to your desktop, so you have no way to actually get a purchased book and send it to the kindle even over USB. However, if you buy non-DRM books from other book sellers you won't have this problem.

Google does not have unlimited. I had to pay to increase my storage.

>Why treat them as the enemy, when a dialog might cause them to reach common ground about what is the right thing.

People like Elon literally are the enemy. He used his wealth to literally change our government in his favor. The idea that we need to go and have polite discussions to maybe change his mind, while he gets to stomp all over us (his DOGE efforts literally resulted in people dying). If a dialog with them was going to work it would have happened a long time ago, but the more we learn about these people the more obvious it is that they believe themselves to be smarter and better than the rest of us. They aren't going to listen to others, and pretending that they will seems like deflecting and giving up in advance. Our best hope is that people can get enough power to regulate billionaires out of existence before a revolution does it instead.

I'm well aware of this: I bought a pretty beefy (consumer grade beefy) GPU machine and run all sorts of open weight models. I do think there is potential.

But are you expecting 360m Americans to start their own businesses? That is a solution that doesn't scale. Consumer grade GPUs aren't going to scale all that much either, and the cost of the models are going up rather than down as vendors start seeking profits. We already see the memory and storage markets exploding in cost due to the rise in demand as well.

> A request is any interaction where you ask Copilot to do something for you—whether it's generating code, answering a question, or helping you through an extension. Each time you send a prompt in a chat window or trigger a response from Copilot, you're making a request. For agentic features, only the prompts you send count as premium requests; actions Copilot takes autonomously to complete your task, such as tool calls, do not. For example, using /plan in Copilot CLI counts as one premium request, and any follow-up prompt you send counts as another.

This clearly isn't true for agentic mode though. This document is extremely misleading. VSCode has the `chat.agent.maxRequests` option which lets you define how many requests an agent can use before it asks if you want to continue iterating, and the default is not one. A long running session (say, implementing an openspec proposal) can easily eat through dozens of requests. I have a prompt that I use for security scanning and with a single input/request (`/prompt`) it will use anywhere between 17 and 25 premium requests without any user input.

Seriously. They can say they want to share their gains all they want, but I don't see them spending any lobbying money on things like universal income (and if Altman can afford to lobby for age verification laws he can certainly afford to lobby for things that actually benefit society). The reality is they don't lobby for anything that would take wealth away from them, and any redistribution of wealth (such as a s 75% tax rate) would by definition take wealth away from them.

This is only true if productivity gains tied to general well being, but instead it's being concentrated in the hands of a few.

Something similar is happening with GitHub Copilot too. It's impossible to know what a "request" is and some change in the last couple of months has seen my request usage go up for the same style of work. Toss in the bizarre and impossible to understand rate limiting that occurs with regular usage and it's pretty obvious that these companies are struggle to scale.

How do you decouple it when the people who own it and are building it seem to be driven on increasing inequality?

I think opt out is stupid, but the notice is on every page of github using their banner display right now. They've also blasted out emails.

This problem is solved by not having a token. Github and PyPI both support OIDC based workflows. Grant only the publish job access to OIDC endpoint, then the Trivy job has nothing it can steal.

You should be using build artifacts, not relying on `uv run` to install packages on the fly. Besides the massive security risk, it also means that you're dependent on a bunch of external infrastructure every time you launch. PyPI going down should not bring down your systems.

The Lego Mindstorm robotics kit that powered the whole thing was discontinued in 2022. Since they're no longer making the robotics kits they have nothing to donate to the competition (or run the competition on).

This is embarrassing. Trivy is a product I've recommended to a lot of people, and have even included it in my book on Terraform, but it's going to be very difficult recommending it going forward if they are going to continue to fail to protect their own artifacts and distribution chains.

I don't expect my security tools to introduce back doors to my own build processes, and I especially don't expect to see it twice in three weeks.

I interviewed with Clockwise years ago and was offered a position, but ultimately I decided to pass for this exact reason. This system is great, and I actually used it and loved it, but it was a feature rather than a product.

While I understand why people want to skip code reviews, I think it is an absolute mistake at this point in time. I think AI coding assistants are great, but I've seen them fail or go down the wrong path enough times (even with things like spec driven development) where I don't think it's reasonable to not review code. Everything from development paths in production code, improper implementations, security risks: all of those are just as likely to happen with an AI as a Human, and any team that let's humans push to production without a review would absolutely be ridiculed for it.

Again, I'm not opposed to AI coding. I know a lot of people are. I have multiple open source projects that were 100% created with AI assistants, and wrote a blog post about it you can see in my post history. I'm not anti-ai, but I do think that developers have some responsibility for the code they create with those tools.

Well, guess I was wrong about that.

Half the time they literally say it in the email. I just looked in my spam folder and just a few hours ago got an email titled "Your profile: Github", that started with:

> I came across your profile on GitHub. Given you're based in the US, I thought it might be relevant to reach out. > > Profile: https://github.com/tedivm

They aren't doing anything to hide it.

Hard to talk about what models are doing without comparing them to what other models are doing. There are only a handful of groups in the frontier model space, much less who also open source their models, so eventually some conversations are going to head in this direction.

I also think it is interesting that the models in China are censored but openly admit it, while the US has companies like xAI who try to hide their censorship and biases as being the real truth.

I solved this problem for my blog by simply not being interesting.

Note that Sparkfun has been less and less of an "open hardware" vendor, as they've dropped the open aspect on some of their most popular projects.

My first thought was the same. I used to like Sparkfun but then they closed the source of some of their projects (while often "forgetting" to update their website to reflect that). I was concerned when I saw the headline but just assumed that Sparkfun was probably in the wrong even before I saw the comments.

Most APIs, even ones you pay for, are rate limited. I don't think having a rate limit changes the open nature of the API. I'm looking forward to seeing if I can plug this in to my Home Assistant install for weather so I can compare it to Pirate Weather which I use now.

When I used to play Screeps[1], a MMO strategy game where you programmed to control your units and buildings, a group of us setup a player that was managed in this exact way called Quorum[2].

If anyone wants to run their own project in this way I open sourced the code to do so under the GitConsensus[3] project. There's a Github App (which may not still work, but if there's interest I'll restart it) and a "run it yourself" python library and CLI you can run from Github Actions[4].

1. https://screeps.com/

2. https://github.com/ScreepsQuorum/screeps-quorum

3. https://www.gitconsensus.com/

4. https://pypi.org/project/gitconsensus/

Just look at the response to the Jade Helm exercises to get an idea, and that didn't even involve murdering anyone.

https://en.wikipedia.org/wiki/Jade_Helm_15_conspiracy_theori...

That's exactly it- they've been putting a ton of work into it over the last two years, and their latest release is by far the best.

Jellyfin has three AppleTV apps!

SwiftFin is what I use, and it is the free and open source option. Works great.

Before that stabilized I used Infuse, but it wasn't great.

MrMC is another one I haven't tried, but it definitely supports Jellyfin.

I think a better analogy would be going into a gun shop and paying the owner to shoot someone. They're asking grok to undress people and it's just doing it.