4,240 karma · joined March 7, 2008
And how did you intervene? Does it have permissions to send emails, or it only created the draft?
This is a pretty interesting example and highly relevant, but details matter a lot if we want to use it as a lesson.
I'd like to know that when I'm reading a comment, it's written (or at least endorsed) by a human being. Currently that's.. debatable, and it's only going to be more so. Entities with cash and resources can focus on the topics relevant to them and drown the conversation. I'd like to at least know that the idiotic replies I'm getting are real human idiots, and not astroturfing in one shape or another.
An example would be the european reaction to AC. It's a way of using technology to solve warming, its costs are perfectly acceptable, but it is still frown upon because... well, it's beyond the scope of a HN comment to diagnose why, but it's an example of technology being able to mitigate a problem but not being allowed to.
And it's FAR from hopeless. Again, global warming is obviously happening. But the amount of adapting and reacting to it is virtually nil. Installing AC. Tree cover in every city. Start serious discussions on what level of risk we want with geoengineering.
Because yes, there absolutely is an acceptable risk level with geoengineering. Planting trees is that. Carbon capture is also that. And better and more effective tech will definitely be available.
But we're in a social climate where I don't even dare write down examples of what those more effective methods would be, because if you're not luddite enough you're the enemy.
You're very likely to use those tools for other things as well, so keep the MCP as just a layer.
You can add a lot of things you wouldn't usually bother with, like telemetry, detailed logs, read only database access (you can even add a llm powered query builder on top) etc.
And if you take off the rose tinted glasses, it's the same... um... what's the word? retardedness. when it comes to the environment. In order to... do what exactly? count carboard boxes better? they created yet another bureaucracy.
This is exactly what I meant by not giving a shit about other people's money (or time=money, in some instances).
I've played with entrepreneurship most of my life - I know how "a solution looking for a problem" looks like. Any VC would laugh them out of the room.
Edit: don't get me wrong - there is a part of this that is almost free and only requires a bit of enforcement. That part is good, and it's exactly what governments should deal with. But anything that imposes direct or indirect costs should go through serious cost/benefit analysis.
By any metric imaginable, it's making the information more accessible, not less. First, it's taking a single copy of a 10k physical print and it's making it digital. Is it "locked"? Yes, by copyright laws, if you don't like that lobby to have them changed. But it's _closer_ to being widely available, not farther.
Plus having the info part of a LLM makes it immediately available to literally billions.
I happen to actually actively shop second hand bookstores, so I am potentially affected by this - as opposed to most people complaining because they don't like the idea. And I still absolutely support it.
Current deal is pretty clean and a win for both parties. US gov won't be drawn into a lengthy trial, RWE gets their money back, US gets a similar value investment, RWE gets a safer investment and a likely friendly government. US made some 40mil from the deal, or more likely 1-200 mil considering inflation; on the other hand RWE didn't lose their whole investment.
A much simpler summary:
- open models good.
- smart models _can_ be bad
- smart open models that can do biotech work are dangerous. worth the hassle of certification _if_ we can get everybody on board with minimalist certification.
- banning open models just in US is neither good or bad: is stupid.
Anthropic should take it from its marketing/strategic budget. It just bought itself a 1.5B moat at exactly the time it can afford it.
I wonder if anybody is keeping track of everything a mid size business needs to take care of. Each particular report probably sounds like a reasonable request, but by now they're probably well into hundreds, and they're all outside the actual scope of the business (e.g. it may seem manageable for the bureaucrats designing them, because that's what they deal with all day, but not for a small organization doing... something else).
This is the wrong question. Having free opinions and emotions is such a basic and fundamental good, that any restriction needs to be a lot more than "a good idea" - it needs to clear a lot of thresholds. So it's more like "is it such an undoubtedly good idea with such a large margin that we want to take the risk?"
What helps most is probably having more antibodies "in the water supply". If we spread concepts like this widely, they'll help once they're common ground for enough people. And I think it helps a lot that PG didn't give examples in his essay. Giving examples would immediately get him coded as x-ist, and color the article as political. And politics is the mind killer...
That's not how you optimize an important metric. At all. You look a how exactly those 60 people die and make targeted interventions with numbers backing them up. Otherwise best case you're doing security theatre, and most likely fuck things up with second order effects. Like things beeping all the time and distracting people - I already can't tell why my car is beeping at me.
Problem is, this creates systemic effects. If you look longer term, a society that does this will end up a lot poorer than one that doesn't. Even for the bottom 51% you were optimizing. Because there are two variables to control: the redistribution, and the actual productivity. If you just focus on splitting wealth, you stop growing wealth.
Growing wealth on the other hand will make everybody richer, including the botton 51%. Simply participating in a richer economy has advantages. Plus the smaller redistribution percentage will actually end up bigger in absolute terms.
Same shock, different direction, much nicer.
Orders of magnitude matter.
I'm not as bitter as I could be. I'm actually quite surprised at the sanity of not avoiding the health topic completely - I think only OpenAI had a few months where ChatGPT was tip toeing in any health related conversation. Otherwise it's been almost completely ungated, and it saved and helped countless lives.
I really wish they'd find a way to ungate health and legitimate research topics.