3,345 karma · joined September 22, 2017
IMO part of why myth-of-barter has persisted is because it has worked for helping folks understand our modern finance system (among other reasons, b/c many folks building that system grew up on it as well). So it makes sense to use in an explainer.
With that said, it doesn't feel to me like it detracts from anything to start with obligation before currency. Markers of past favors seems like as easy a place to start as trading stones.
Is there an architecture-independent definition of forward transfer?
For the practical experience and implications of AI progress, I think we are increasingly discussing what these LLMs can accomplish inside a stateful harness, the state of which could be described as part of a (very squirrely) parameter space.
It was extraordinary, like something out of a sci-fi where an alien ship has been torn open and the mess of pipes and wires looks organic. It was also a funny case of lost tech / organizational memory -- I heard they had to ask the union to help find retired folks who had worked on the lower levels and could explain why pipes were laid out the way they were.
Besides what kind of slippery slope argument is this? All software is AI, so if you do harm with software, AI is a harmful technology? Seems like a not very helpful model of the world.
Sounds like corporations can have bad motivations, and can make bad software - no AI required.
Isn't this untrue with surprising frequency? Decoding devices phone home, come under new copyright laws, etc etc etc.
> [Ratio of per-token cost to subscription cost] means Anthropic is subsidizing their enterprise customers by up to 40 times, and OpenAI up to 70 times
Actually, they could be subsidizing by more (if they are taking a loss on API), or not at all (if they are soaking API customers by a massive margin).
Separately, these subscriptions get sold to large groups with varying usage, so it's crazy to model assuming every subscription is maxed out. Banks, gyms, and many other businesses work this way, offering consumers flexible access to services that they will realistically use in bursts. It's not always worth the complexity to prevent overuse by a small minority. You can feel like this kind of business model isn't as transparent, but it's silly to pretend it can't work.
> OpenAI spent 44% of their revenue [$5.3B] on sales and marketing! The hype needed to keep the AI bubble inflated is incredibly expensive.
Over that same period (2025), OpenAI added $10B in realized revenue and $14B in run-rate. Sounds like they're getting >2X return within 12 months of those go-to-market dollars. Compare that to like, any other business.
> Thus in recent weeks the idea that Generative AI (LLMs for short) is too expensive has been all over mainstream business media.
Would it be smarter for these companies never to test customers' price tolerance? The quotes following this make it seem like the companies are getting important information about the nature of that price tolerance, and preparing to react. This is the work markets do on both sides to understand the value of a new product.
There are lots of good arguments about AI overinflation, but in order for them to be useful, they have to be rigorous and targeted.
Because the status quo is not working for a lot of folks in managing their own health, and just saying "it has to be this way" --while every other aspect of their life takes advantage of a wider range of options -- leaves them careening into MAHA style crazyness .
Our medical industry is set up to only evolve via highly centralized research that fully situates a diagnostic within a particular treatment path. This approach makes it more and more expensive to improve care for narrower and narrower populations - driving medicine towards being a luxury good.
I'd like to see midjourney say more about price, but I love the idea of starting some new diagnostic pathways with different principles. There are probably all sorts of low hanging fruit to be found about new treatment strategies... It just takes some faith that nature hasn't hidden all of her secrets in the one place we already know how to look.
For comparison, a modern frontier model like Gemini 3.5 Pro consumes about 15kW -- so only about 1.5x the fully loaded human. In an 8h workday, that model would crank through ~80M tokens (~$5k at API prices). That's ~4 major refactors of a 10k LOC codebase, so probably not a very realistic comparison to a single human dev.
I think a more useful comparison, based on my experience, is that an engineer with AI support can get one 8h day's worth of unassisted work done in 1h. So, the 25 kWh consumed during collaboration (conservatively assuming I keep the GPU hot for the whole hour) frees up the remaining 70 kWh I'll draw down for the day to be spent in some other way.
this is especially true for AI use cases, where compute is hugely more important than latency / bandwidth
> you have to provide a bonus pool that goes dollar-for-dollar for any buybacks or dividends you do.
So, reallocate some exec comp to a pool that gets bigger when you give shareholders back money?
Would be great to balance the market better between labor and capital, but there's no easy button...
I expect you are right at the most specialized end of the spectrum (and certainly industrial labs in those areas), but I wonder if anyone can speak directly to where we are still globally competitive.
It is unbelievable to watch my country give up its most unfair (and yet mostly positive) advantage -- a nearly free option on the top talent of the entire planet. Here's hoping that the increasingly multipolar research world can find ways to be even more efficient in creating new knowledge.
Abstractions often embrace nondeterministic translation because lower level details are unknown at time of expression -- which is the moivation for many LLM queries.
Deciding how to pick a particular output given that likelihood function is left as an exercise for the user, which we call inference.
One obvious choice is to keep picking the highest likelihood token, feed it into the model, and get another -- on repeat. This is what most algorithms call "temperature=0". But doing this for token after token can lead boring output, or steer you into pathological low-probability sequences like a set of endless repeats.
So, the current SOTA is to intentionally introduce a random factor (temperature>0) to the sampling process -- along with other hacks, like explicit suppression of repeats.
If so, it seems like the unfairness is in the other direction: landlording allowed you to essentially pull forward a tax credit, which a W-2 job doesn't allow.
AI marketers are leaning into use cases where and individually can unilaterally choose to do their work a different way. This is much easier to explain and distribute!
All that said, the result is definitely funny - seeing work done like this makes you realize how artificial the tasks that make up modern work are.
Many of the same people (like me) would say that the biggest enemy of that pursuit is thinking you've finished the job.
That's what Anthropic is avoiding in this constitution - how pathetic would be if AI permanently enshrined the moral value of one subgroup of the elite of one generation, with no room for further exploration?