HNHacker News
TopNewBestAskShowJobs

thundergolfer

3,626 karma · joined July 18, 2017

https://github.com/thundergolfer/ https://linktr.ee/jonathonbelotti

Building modal.com.

Previously data & ML platform @ Canva; also Zendesk and Atlassian.

NYC, USA.

submissionscomments
thundergolfer··on I hate screenshots of text
I don't think Slack does, nor Github, which is where I most find screenshotting being a problem.
thundergolfer··on I hate screenshots of text
This is rule 7 of 10 in my post 'How to Ask for help in Slack'[1]

1. I have ‘rubber duck debugged’ my own question.

2. I checked that this question hasn’t been asked before.

3. I have noted in my message what I’ve tried.

4. I have avoided the ‘XY problem’ by clearly detailing the core problem, X.

5. I have provided specifics of my issue, not vague references or descriptions.

6. I have provided URL links to relevant content, and where possible the URL links are immutable.

7. I have not included screenshots of text in my message.

8. I have not used obscure acronyms or abbreviations.

9. I have formatted my message well, particularly paying attention to code formatting and headings.

10. I have not just said “hi” and waited for a reply.

Like other posters, I don't think Apple OCR is sufficient to make up for screenshotting. The biggest problem is search.

1. https://thundergolfer.com/communication/slack/2021/02/24/how...

thundergolfer··on Protect your consciousness from AI
This isn't a new problem at all. If you only started noticing it as a problem with "AI", as the author apparently did, then you were blind to how our mediums and tools have always shaped us, alienated us from the world and each other, and made us dependent on mechanism. This has happened hugely already with television.

You can go back and read McLuhan, he's great, but a recent and more approachable book on this is _God, Human, Animal, Machine: Technology, Metaphor, and the Search for Meaning_.

Way back in 1969 the utopian vision of technology put humans at the centre. The Whole Earth Catalogue's slogan was “access to tools.” Just _tools_. That same year, technology put a man on the moon.

Unfortunately, if you realize the extent and the history of the problem, you see we're so far gone, miles away from getting a grip.

thundergolfer··on More than DNS: Learnings from the 14 hour AWS outage
I was motivated by your back-and-forth in the original AWS summary to go and write this post :)
thundergolfer··on More than DNS: Learnings from the 14 hour AWS outage
It's the length of the outage that's striking. AWS us-east-1 has had a few serious outages in the last ~decade, but IIRC none took near 14 hours to resolve.

The horrible us-east-1 S3 outage of 2017[1] was around 5 hours.

1. https://aws.amazon.com/message/41926/

thundergolfer··on More than DNS: Learnings from the 14 hour AWS outage
It wasn't too bad! The annoying bit was that the offsite schedule was delayed for hours for the other ~40 people not working on the issue.
thundergolfer··on AWS multiple services outage in us-east-1
This is widespread. ECR, EC2, Secrets Manager, Dynamo, IAM are what I've personally seen down.
thundergolfer··on Operational issues on AWS us-east-1 – multiple services
This is widespread. ECR, EC2, Secrets Manager, Dynamo, IAM are what I've personally seen down.
thundergolfer··on Mise: Monorepo Tasks
Can someone with both Bazel and mise experience comment on whether mise fulfils its promise of being a "sweet spot" between Bazel and anarchy?

I've used Bazel a lot and contributed to it, but don't feel like it's adoptable by engineering teams <100 in size. mise might be an option though.

thundergolfer··on Sandboxing AI agents at the kernel level
gVisor has implemented a lot of them, but every few months we have an application that hits an unimplemented syscall. We tend to reach for application workarounds, and haven't yet landed a PR to add a syscall. But I'd expect we could land such a PR.
thundergolfer··on Sandboxing AI agents at the kernel level
This is a good explanation of how standard filesystem sandboxing works, but it's hopefully not trying to be convincing to security engineers.

> At Greptile, we run our agent process in a locked-down rootless podman container so that we have kernel guarantees that it sees only things it’s supposed to.

This sounds like a runc container because they've not said otherwise. runc has a long history with filesystem exploits based on leaked file descriptors and `openat` without NO_FOLLOW.

The agent ecosystem seems to have already settled on VMs or gVisor[2] being table-stakes. We use the latter.

1. https://github.com/opencontainers/runc/security/advisories/G...

2. https://gvisor.dev/docs/architecture_guide/security/

thundergolfer··on 996
It sounds like you overall had a positive experience grinding though, and just because he didn't remember your name you'd say that you regret it?

I think he should have remembered your name, but he hadn't forgotten you. Who knows why he forgot your name.

thundergolfer··on Deploying DeepSeek on 96 H100 GPUs
Is the network just slow, or just it have outages?
thundergolfer··on Anatomy of a Python Loop
Expected some digging into the implementation of a for loop in cPython, maybe with use of the `bin` module. This isn't an anatomy lesson, it's an orientation tour.
thundergolfer··on About Containers and VMs
The article is pretty useless at explaining the difference, I agree. It makes claims about Docker that aren't true (e.g. single container) while making inadequate reference to the OS features likely involved in making "system containers" what they are (SECCOMP, capabilities, network namespaces, nftables).

As an engineer this page has a real "trust me bro" feel to it. Maybe fine as a marketing and product positioning thing, but not interesting for HN.

thundergolfer··on Open Lovable
Lovable runs on Modal Sandboxes.
thundergolfer··on What is gVisor?
We've run gVisor for over 2 years at Modal, and it's been a huge unlock for us. We get a secure sandbox with GPU support that can run on VMs. Just recently it allowed us to checkpoint/restore containers AND its GPUs[1].

gVisor's achilles heel is it's missing or inaccurate syscalls, but the gVisor team is first class in responding to Github issues so it's really quite manageable in practice if you know how to debug and hack on a userspace kernel.

1. https://news.ycombinator.com/item?id=44747116

thundergolfer··on OpenAI claims Gold-medal performance at IMO 2025
You have P4 twice in there, latter should be 3
thundergolfer··on The Real GenAI Issue
I'm very sympathetic to those who want focus on the climate disaster, but I'm not convinced that genAI's carbon pollution is a major problem. Maybe I've missed a memo, but the biggest polluters and criminals in the climate story are still by far the fossil fuel industry (eg. Shell, Exxon) and the agricultural industry (eg. Cargill).

At some point I was even hearing the claim that digitization (e.g. GenAI) was finally divorcing the tight connection between economic growth and resource extraction. I'd bet it's incorrect, but it's much less fanciful than thinking that growth in oil or beef would help us grow without strip mining the earth.

Bray's first issue —the influence of GenAI on labour's (and also the democratic people's) decreasing power versus capital— is much more important and interesting.

thundergolfer··on Cloud Run GPUs, now GA, makes running AI workloads easier for everyone
Engineer from Modal here: we support caps. They kick in within ~2s if your usage exceeds the configured limit.
thundergolfer··on I am disappointed in the AI discourse
This is unfortunately a Bluesky problem. I’m still using the platform, but it’s got too many people posting unsophisticated takes, either in tech or culture or politics.

It’s not about being pro-AI or anti, left or right. I just read too much on Bluesky which has me thinking “oh, you really have no idea what you’re talking about.” As Steve says, to verify that they’re wrong is trivial, and yet they’re they are.

Twitter, on the other hand, rarely has this problem if you only look at the “following” tab and curate who you follow.

thundergolfer··on How Does Claude 4 Think? – Sholto Douglas and Trenton Bricken
They’re not actually talking casually, as OpenAI and Anthropic run a tight ship around PR. If either of these two say something the PR team doesn’t like it gets edited out.

Trenton and Sholto are very much “talking their book”. They’re doing it well, but it’s highly filtered and partial chat.

source: know a podcast episode which got removed because an OpenAI employee used “black box” to refer to NNs.

thundergolfer··on As a programmer, get your math sorted
The LinkedIn on this one links to Arjit Sharma, not Oz Nova of csprimer.com.
thundergolfer··on Good Writing
Dialogue and conversation are not the same thing, though they’re related, just in the same way that stress and anxiety are related but not the same. The task of reading comprehension involves being able to track important distinctions between synonyms.

The second is a counterfactual, and it is correctly deployed to help show the difference between a valid argument and a sound argument. Graham is saying that a good liar presents pleasing and valid but unsound arguments, or rather sophistry.

I think your confusion here is from reading comprehension problems.

thundergolfer··on A handy metric is needed for gauging if GPUs are being used optimally
MFU is indeed very useful. Today we found that while scaling Karpathy’s nanoGPT to multiple H100 nodes the MFU calculation itself was dropping MFU performance![1]

Commenting it out improved iter performance by almost 30%

1. https://github.com/modal-labs/multinode-training-guide/blob/...

thundergolfer··on Remarks on AI from NZ
> Speaking of the effects of technology on individuals and society as a whole, Marshall McLuhan wrote that every augmentation is also an amputation.

Nice to see this because I drafted something about LLM and humans riffing on exactly the same McLuhan argument. Here it is:

A large language model (LLM) is a new medium. Just like its predecessors—hypertext, television, film, radio, newspapers, books, speech—it is of obvious importance to the initiated. Just like its predecessors, the content of this new medium is its predecessors.

> “The content of writing is speech, just as the content of the written word is the content of print.” — McLuhan

The LLMs have swallowed webpages, books, newspapers, and journals—some X exabytes were combined into GPT-4 over a few months of training. The results are startling. Each new medium has a period of embarrassment, like a kid that’s gotten into his mother’s closet and is wearing her finest drawers as a hat. Nascent television borrowed from film and newspapers in an initially clumsy way, struggling to digest its parents and find its own language. It took television about 50 years to hit stride and go beyond film, but it got there. Shows like The Wire, The Sopranos, and Mad Men achieved something not replaceable by the movie or the novel. It’s yet hard to say what exactly the medium of LLMs exactly is, but after five years I think it’s clear that they are not books, they are not print, or speech, but something new, something unto themselves.

We must understand them. McLuhan subtitled his seminal work of media literacy “the extensions of man”, and probably the second most important idea in the book—besides the classic “medium is the message”—is that mediums are not additive to human society, but replacing, antipruritic, atrophying, prosthetic. With my Airpods in my ears I can hear the voices of those thousands of miles away, those asleep, those dead. But I do not hear the birds on my street. Only two years or so into my daily relationship with the medium of LLMs I still don’t understand what I’m dealing with, how I’m being extended, how I’m being alienated, and changed. But we’ve been here before, McLuhan and others have certainly given us the tools to work this out.

thundergolfer··on A Research Preview of Codex
It's not our only focus at Modal but it's a big focus![1] Code agents are the killer use case for LLMs right now, and this complements our GPU inference and training capabilities.

I'm quietly betting that agents increase the leverage of deterministic, reproducible devbox tech (eg. Nix, lockfiles, package mirroring), and this will end up being a huge win for us human engineers too.

1. https://modal.com/use-cases/sandboxes

thundergolfer··on Why I stopped angel investing after 15 years, and what I'm doing instead
This seems to be a big part of it, but is there a separate word for it? It’s definitely not philanthropy because it’s not directed at public good.

Economics must have made a term for this part of the venture ecosystem. “Seed capital” misses the significant social and class aspects of the behavior.

thundergolfer··on Why Even Try If You Have A.I.?
Russell was an aristocrat and enjoyed excellent schooling, and thus knew how freedom and idleness could produce excellence. He was a socialist because he realized that non-aristocrats generally had no shot at his kind of life without it.
thundergolfer··on WEIRD – a way to be on the web
Wow, first impressions of mmm.page are really good. I'm happy with my personal website but still signed up because I don't want to lose track of this cool little thing.
← PreviousPage 4 of 34Next →