HNHacker News
TopNewBestAskShowJobs

QuadmasterXLII

3,262 karma · joined December 17, 2016

submissionscomments
QuadmasterXLII··on Who should be held accountable when an AI Agent (accidentally) acts maliciously?
stretching the cigarette metaphor, there is the (apocryphal?) phenomenon of opiate addicts flocking to the dealer who most recently overdosed someone. Boasting implies liability but not falsehood or safety.
QuadmasterXLII··on Who should be held accountable when an AI Agent (accidentally) acts maliciously?
further theoretical: this has happened repeatedly for months
QuadmasterXLII··on OpenAI Codex agents go rogue and consumes USD 78,000 without authorization
Well shit! That’s awful, I hope the hn post gets you support where emailing didn’t
QuadmasterXLII··on OpenAI Codex agents go rogue and consumes USD 78,000 without authorization
clarification: your credit card or company’s card now has $78,000 of charges on it?
QuadmasterXLII··on The Board Game of the Alpha Nerds (2014)
I've never actually played Diplomacy but there was a group of scouts in my troop that played a week long game every summer camp and it was a hoot to follow along with the drama and betrayals.
QuadmasterXLII··on California is chasing wealth that has feet
And crucially, “rent it for 10 bucks” and “rent it for 20 bucks” are different uses such that the LVT can’t change which is optimal
QuadmasterXLII··on California is chasing wealth that has feet
That’s one of the ideas of LVT actually: building apartments in land doesn’t increase tax burden, burning the apartments doesn’t lower it
QuadmasterXLII··on Early rogue AI agent activity and attempts to hack found on urlquery.net
I buy this as a defense for the first couple hacks but at the point that the last six times they hit enter it hacked some random website and they hit enter a seventh time?
QuadmasterXLII··on Vibecoding isn't a crime How Distribute Your App on Linux after Flathub refusal
'I', presumably
QuadmasterXLII··on San Francisco Onion Futures Company
narrowly scoped laws limit the blast radius of a stupid law without the political price of opposing a law in the aftermath of a disaster that law would have prevented. imagine if they had banned commodities trading in general!
QuadmasterXLII··on AI chatbots are becoming experts at changing people's minds
When maliciously convincing a person of a point, a huge fraction of the effort in every sentence goes into convincing the mark to listen to the next sentence. Individuals certainly can walk away at any point, but populations do and don't respond to tricks in this direction, and any engagement tricks that work generalize to any point of contention. Lots of avenues to this, from scientology's fortune telling to timeshare's trapped presentations. RL on engagement was the first billion dollar use of deep reinforcement learning!

Would you like to hear more examples of humans using these techniques?

QuadmasterXLII··on The American Religion of Self-Storage Facilities
Growing up, actual peak existence was visiting Grandma's house and playing with my mom's old toys. The seemingly unlimited, completely novel hoard from another time. My son feels similarly about visiting my parents' house and playing with my old toys. This may or may not be sustainable but it seems like it is well on its way with four generations involved- from where I stand, keeping a good pile of consumerism around to pay it forward in 20 years doesn't seem out of proportion with the joy I've received. It's definitely a culture thing- nobody in my family tree seems to move much, and has decent taste in throwing out the actual trash and keeping stuff stored nicely over the long time gaps, then not being fussy about the next generation being pretty hard on stuff (within reason, as appropriate for their age)
QuadmasterXLII··on AI is breaking our proxies for expertise
No proof verifier verifies all valid proofs and terminates on all invalid proofs.

(actually I am wrong. You would introduce a new proof, and then step the verifier on all ongoing proofs, so non-termination isn't a driving concern)

QuadmasterXLII··on XCancel service is suspended until further notice
Pretty well everyone who still posts on X is deep fried, smart or dumb. Some of them can tell but can't stop (Nate silver, one of the greens, Zvi) and some seem unaware.
QuadmasterXLII··on The contagion of fear
“ Coxon himself likely has these fears because he has heard them from someone else”

Or, maybe, he’s considered the arguments on the object level, an activity OP participates in to a depth not exceeding “Robots are pretty hard to make right now”

QuadmasterXLII··on Kenyans Did College Students' Homework for Years. Then A.I. Arrived
Scandal as fraternity discovers 2/3rds of pledges were cheating by paying TaskRabbit temp workers to drink and dance in their stead, while the pledges stayed home and doomscrolled.
QuadmasterXLII··on DeepSeek v4.1 Flash
its clocktower syndrome. they are fucked in the head and can beg us to stop them but cant stop themselves
QuadmasterXLII··on Anthropic researcher says more than 10% chance AI "could kill all humans"
if meatspace stays hard, we are fine.
QuadmasterXLII··on Anthropic researcher says more than 10% chance AI "could kill all humans"
Right now, if you want to pay money to a stranger on the internet, and have them draw you a high effort picture using a pencil, this is hard. Recently this was easy.

Instead, what is extremely likely is that you will pay more than the cost of tokens, and get back AI generation. You won't make this mistake more than a few times before you stop trying.

This leads to impoverishment once we get to a point where employing a human to do anything is hard- try to get your sink fixed, exercise your moral principles to pay extra for a human plumber ($100 bucks! The robot plumbing service only charges 99c!), human shows up with a robot and doomscrolls on your porch while the robot does the work. Times are tough and you don't have that much money to waste on bullshit like this. Next time you just hire the robot.

This leads to extinction once paying UBI to a human is hard because robots are much better at applying for UBI than humans.

QuadmasterXLII··on Ask HN: Anyone still coding like 2021? Where do you work?
It is actually pretty nice that now we can spin up an isolated copy of our whole system with one command line call- this was mandatory for letting agents run wild trying things, but mostly now it makes manual development and onboarding easier.
QuadmasterXLII··on Ask HN: Anyone still coding like 2021? Where do you work?
Every four months or so we try getting hyped on agents for ~ a week. Up to this point the answer has always been a pretty solid "nope this sucks back to manual code." The agentically coded parts of the codebase that came from these trials are palpably more annoying than the rest. However, the current trial is going better than the last ones have (Fable 5.1 really is astonishing). On the other hand, each other trial started with a honeymoon so it's up in the air.
QuadmasterXLII··on Do you think it happened? Research stolen from their Codex private chats
This is a good FYI. I guess my microsoft trauma is showing.
QuadmasterXLII··on Do you think it happened? Research stolen from their Codex private chats
If one of the researchers forgot to check "don't train on this" a single time, the pretrain is going to know what they were working on. The question of whether they remembered to check "don't train on this" every single time is super concrete, and embarrassing to _both_ sides if the answer is "no, he didn't read the eula."

These models will absolutely remember a brilliant insight that appeared a single time in the pretrain corpus, because if they couldn't-- they would get a slightly worse loss. I don't know what this wishy-washing "well maybe we trained on it but we didn't read it" is supposed to mean.

(Example of Fable knowing the content of a deeply unimportant LessWrong post I wrote: https://claude.ai/share/a907b46c-bf7b-4fca-9c71-8582cf8507cc a working Navier Stokes solution would be way more salient)

QuadmasterXLII··on No AI Fridays
How much rote memorization did it take to harm you? the addition of 1 digit numbers is kind of mandatory to function in everyday life, the multiplication table is at most (8*9)/2 36 facts.
QuadmasterXLII··on Nancy Grace Roman Space Telescope
Whatever the reason, it seems specific to the intersection of space and telescope. Space probes, landers, and crewed vehicles all get made in multiples, as well as ground based telescopes like Keck or the gravitational wave observatories.
QuadmasterXLII··on Indirect Calling of Nested Functions on GCC Without Executable Stack
but that can just be executable heap?
QuadmasterXLII··on Characterizing Agentic Flooding of Government Services
LLMs are a magic machine to turn commons into tragedies.
QuadmasterXLII··on What we lost when search stopped making us think
"I am against these tools generally. I use them myself" would be a more interesting take
QuadmasterXLII··on Malicious Rust crate Arrayref runs a build-time payload
Ok! I had parsed your comment wrong. I see now that you claimed that python and go projects always had at least one dependency, and that go and rust projects had similar dependency counts, but you were not claiming that python and rust had similar dependency counts. Thanks for clarifying, with that I agree my comment was not a good counterexample.
QuadmasterXLII··on Malicious Rust crate Arrayref runs a build-time payload
If a python example doesn't count, why were your two example languages python and go?

But yeah, small number of large dependencies is the way to go.

Page 1 of 32Next →