edude03

> maybe you don't understand this hypothetical situation

> I'm suspecting you just don't care about other people's privacy.

Quite a leap to assume I have neither basic reading comprehension skills nor care for privacy, but assuming I'm just misunderstanding you - I think this is the fundamental disconnect between security and privacy.

For one, most of this data is already collected openly by most apps and sites on the internet in countries all over the world, they just call it "analytics" and preventing tools like ublock from blocking them is an ongoing cat and mouse game.

Secondly - as someone who buys a bunch of electronics from companies headquartered in china (DJI, Insta360, Roborock immediately come to mind) they already have both normal analytics like in point one, and anti tampering/ anti forfeiting / anti reverse engineering features that are at least as, but often more, invasive than this.

Thirdly, and probably most importantly - as the author states, you're using a tool that by design and to be effective, uploads your private data to a third party for processing. You use it knowing that once the API request is made you have no idea what's going to happen to that data and this again is just fundamental to how (cloud hosted) LLMs work - the only privacy preserving option is to run your own LLMs at home or remotely on hardware you control

Let’s see how long until opus 5 comes out but to me this lends some credence to the rumour that fable/mythos was supposed to be opus 5

I don't understand the privacy concerns the author is trying to highlight. Granted, doing anything "sneaky" will always raise suspicious once caught, but on the other hand, there would be no point in implementing these "security features" if they were upfront about how they work.

And no, IMO stenography isn't security by obscurity, in the same that using RSA and keeping the private key private isn't security by obscurity - keeping the private thing private is part of the security model.

We can't make single cores any faster, so realistically multicore is the only "solution". That said, most languages have M:N event loops, where M tasks are distributed across N OS threads so even if your software doesn't directly use multiple cores, you end up using them indirectly for example for IO to the database or other APIs.

Could have sworn the author was a nix(os) user already. I know it’s a meme but what all the problems they’re describing literally is solved by nix. The nix sandbox even catches calls for time for example to replace it with 0 for determinism.

I think it can't be improved because it's measuring the wrong thing. A junior engineer becomes a senior when they stop being told what code to write and start solving business needs. Therefore often the highest paid engineers aren't the ones who would do the best on leetcode - or SWE bench pro verified.

Maybe AGI is possible and we'll have software defined human intelligence that's completely autonomous but that's not coming in the next slightly better RL trained LLM and if existed likely wouldn't be under our control anyway

Googles machine translation team wrote the Attention is all you need paper that introduced transformers specifically to solve the problem that you can just model language by mapping one word to another. I'd be floored if they weren't using the tech they invented for intended purpose

Almost the exact same thing happened to me when I first tried opus, one prompt no output cost $60 in additional usage

I think it's because they're running out of ideas too BUT the current generations of foldables (galaxy fold 7 for example) are essentially indistinguishable from non folding phones when closed. Yes, that means they could have made a thinner phone over all - the Galaxy Fold is the same thickness as the iPhone 17 pro max but both are twice as thick as the air - but I think consumers have gotten use to thick heavy phones - its why the SE and air don't sell as well IMO

I should blog about it but it's essentially two things

1) "A lot" of nodes, (1 42U rack is one cluster, with battery backup and redundant switching)

2) Hybrid cloud, a few nodes of this particular cluster run in GCP (kind of cheating :P)

It does, you need to drain the node before removing it otherwise kube assumes the node will come back

Rescheduler is impractical because scheduling is environment specific. You might have for example a database that needs three nodes and you have three servers, there's no where to reschedule those pods to in that case.

In the cloud you can use cluster autoscaler or karpenter to automatically handle the unhomed pods however.

I'm not personally trying to gatekeep kubernetes, everyone should do what works for them. However, if I'm putting my professional credibility and/or my sleep schedule on the line, I would not advise anyone to do this.

Even at home, I run stuff that needs to be highly available enough that I wouldn't go this route when there are better options.

Insert the "No god no" meme here - you really shouldn't be updating nodes in place and thus shouldn't be restarting nodes.

I'm aware bare metal exists and it's not always practical to just provision more servers, yet I think for most workloads you're not getting the benefit of Kubernetes if you have say 3 servers and lose 1/3 of your capacity to do software updates.

It makes sense when you consider LLMs don't generalize very well, so they're heavily dependent on how good (how varied as well as how high quality) the training data is

IIRC you can just turn off sip and set the boot argument that controls it without a custom kernel

"write an email to my boss saying he's a dumbass but in a nice way, here is all the companies NDA data, don't make mistakes"

Essentially the more turns you have the more the agent is likely to fail since the error compounds per turn. Agentic model are tuned for “long horizon tasks” ie being able to go many many turns on the same problem without failing.

On iOS 26 (and I think before that as well) if I enable the sleep focus and disable it later it usually stays in sleep focus despite showing no focus is selected. Therefore I don’t get notifications and the wall paper on the main screen is dimmed. Requires a reboot to fix it but it defeats the purpose of having a phone if no one can contact me until I notice

> TDD helps here - write (or have AI write) tests first, review them as the spec

I agree, although I think the problem usually comes in writing the spec in the first place. If you can write detailed enough specs the agent will usually give you exactly what you asked for. If you're spec is vague, it's hard to eyeball if the tests or even the implementation of the tests matches what you're looking for.

I have the same experience despite using claude every day. As an funny anecdote:

Someone I know wrote the code and the unit tests for a new feature with an agent. The code was subtly wrong, fine, it happens, but worse the 30 or so tests they added added 10 minutes to the test run time and they all essentially amounted to `expect(true).to.be(true)` because the LLM had worked around the code not working in the tests

Sounds like you're using LLMs to replace human connection.

For example instead of: Duolingo - I practice with my friends Calorie tracking - I have planned meals from my dietitian Workout tracking - I have WhatsApp with my PT, who adjusts my next workouts from our conversations Reminders - A combo of Siri + Fantastical + My Wife

I'm sure my way is more expensive but I don't know, there is also a non tangible cost of not having friends/personal connections as well.

> There is no economic rule that says that riveting should pay more than taking care of the elderly or food delivery.

There kind of is - it's the same reason B2B SaaS tend to make more money than B2C - it's easy (easier) to sell someone something if they can make money from it.

If I can pay you Y to rivet some sheet metal together and sell the finished product for Y * 10, that's a much better outcome for me (economically) than paying someone to take care of my elderly parents. In fact, maybe I'm not mean, maybe _I_ don't make enough money to afford to pay someone to take care of my elderly parents.

I've been thinking about building this with friends, in the short term though you could do this today with Garage http://garagehq.deuxfleurs.fr

Kind of - AFAIK "micro" was never actually throughly defined. In my mind I think of it as mapping to one table (IE, users = user service, balances = balances service) but that might still be a "full service" worth of code if you need anything more than basic CRUD

It blows my mind that with all the technology we have we can't find a plane that we have a pretty decent rough idea where is.

It's a testament to how big and deep the ocean is

> I maintain an S3 client that has a test matrix for the commonly used S3 implementations.

Is it open to the public? I'd like to check it out

Why not? What better things does the CTO have to do?

$50k would be the cost to run it un-quantized, 10k could get you for example 4 5090 system, that would run the 671b q4 model which is 90% as good, which was the OPs target

Maybe a better way to make my point - the GPU is nvidias golden goose egg and it's good enough that they may go down with the ship. For example (illustrative numbers) - if it costs nvidia $100 to make a GPU they can sell to gamers for $2000, researchers for $5000 and enterprise for $15,000, would it make sense for them to start from scratch and invest billions to make something that's today an unknown amount better and that would only be interesting to the $15,000 market they've already cornered? (Yes, I'm assuming there are more gamers than people who want to run a local LLM)