1,505 karma · joined March 23, 2016
You can broaden the definition of classifier to anything that internally divides its input space into regions, but that definition would include every neural network, whether biological or artificial. So it's not very meaningful, and certainly doesn't give any insight into how they differ from humans.
The side benefit is all your dishes are always available. With the dishwasher, up to one full dishwasher load are dirty at any time, which means you need more dishes and more cupboard space than someone without a dishwasher.
If the robot is going to clear your dishes and wash them for you right away, what's the dishwasher for? To save the robot 10 minutes?
If the future home robots are any good, it saves you from buying a dishwasher and robot vacuum. It can replace a maid/cleaning service and gardener/lawn-mowing service. For anyone paying for those services, it pays for itself.
$1000 isn't that high. Probably about a third of American households have an appliance over $2000, which is still a massive market.
It would be very hard for anyone to make a good music video with the tools Fable and Sol had available to them. They don't have precise control over the clips that get generated, and they can't see or hear the result, other than screenshots. So I'm not sure what the experimenters expected.
By contrast, when coding, devs typically have hundreds of thousands of tokens in the context window, and may use many millions of input tokens per day.
Caching requires the full prefix to match exactly. If a single word differs near the beginning of the prompt, nothing after that can share the cache. So this type of caching would save a few queries that cost virtually nothing, but wouldn't help with the stuff where cost matters.
I'm going to firmly push back on this. A reasonable, straightforward interpretation of AOC's quote is that "you can't earn a billion dollars" without cheating or abusing others. I'm can believe she may have meant that as hyperbole, but even if she did, PG believes "What she meant was that it's impossible to get that rich without doing something bad — without cheating in some way." He's not doing mental gymnastics to get there; it's a straightforward reading of "you can break rules, you can abuse labor laws, you can pay people less than what they’re worth, but you can’t earn that."
That makes PG very much not strawmanning. He's arguing directly against her stated position. He doesn't steelman her argument (create a stronger or more generous version of her argument and argue against that), which could have made his argument stronger.
That also means I'm not strawmanning. PG's position is exactly what I said: that it's not impossible to become a billionaire without doing something bad. He is quite clear on that. Nowhere does PG use language implying all billionaires don't cheat. Only AOC does that, if you take her words literally.
I think you're basically doing what you accused me of doing here: greatly softening AOC's position. Did Dropbox spam users' contact lists to grow? (They didn't, AFAIK, though they did have a referral program to invite friends.) This is a huge downgrade in accusation of wrongdoing compared to breaking rules and abusing labor laws.
If you soften your definition of cheating to this level, it's no longer a billionaire thing. It's an everyone thing. Does my gardener report all his cash income? Has a friend ever streamed a TV show less than legitimately? AOC isn't trying to nitpick the smallest infractions. She's trying to paint becoming a billionaire as substantially corrupt.
You'd rather they signal their virtue and give up their ability to make a difference.
That greatly reduces your GPU memory bandwidth though. Sampling a subset of the texture only transfers that subset. Reading from higher mip levels uses less bandwidth. If your textures are high enough resolution to appear sharp at both resolutions (at least one texel per pixel), you need 4x more bandwidth to sample your material textures at 4k screen resolution for the same scene.
More importantly, material texture sampling is not most of your bandwidth to begin with. At 4k, most of your bandwidth is going to your full screen render passes. Especially with deferred rendering.
> DLSS isn’t just a magic on switch for free perfect up scaling. If you rendered at 720p and DLSS’ed up to 1080 it’s still going to look pretty rubbish.
I don't find this true at all. DLSS 4 Balanced looks excellent and renders at less than 720p for 1080p output.
Absolutely an RTX 3060 is a more normal gamer GPU than the 5090, but you're also not playing in 4k without DLSS on a 3060. Drop to the most common resolution on Steam (1080p), and turn on DLSS and you've basically cancelled out that 6x factor in bandwidth. Even if the 3060 had more bandwidth, it doesn't have enough processing power for native 4k gaming in typical games. So 360 GB/s is still a lot of bandwidth for the resolution most 3060 gamers are using.
Plus, DLSS can greatly reduce the bandwidth requirements for 4K gaming.
> There's no real serious debate here. Everyone's just vibing
Sure, but if everyone including Ted Chiang is just vibing, and no one can prove anything, that makes Ted's statement false and Anthropic's statement true.
> If you (or Anthropic) want to claim "but this is philosophy
I'd just like you or Ted Chiang to not pretend your vibes are science. You're welcome to have them. I also don't think LLMs are conscious. But it's our personal judgement, and not scientific fact.
In the graph, fertility rates decline with income until around $275k. Those aren't families who can't afford housing. Those are well-off families with low birth rates. The birth rates start to climb in that chart only for the ~4% wealthiest families.
Also, you might reasonably conclude from that chart that rich women (in the $400k+ brackets) have more children, but that's not what the chart is actually showing. It's a synthetic total fertility rate, and not the actual TFR. They look at how many children women in that income bracket had this year, and estimate how many children they would have had if kept that reproductive rate for their whole reproductive period. That's going to misestimate the true rate due to selection effects. So, for example, a women who only wants one child is more likely to choose to have that child at 30, when her family income is higher, than at 18. But that doesn't imply she would have had more children if she had more money.
To put it another way, even if giving people more money had no effect whatsoever on their total fertility rate, you'd still expect the graph to curve up like that due to how people time their pregnancies.
1. A null hypothesis is part of a statistical test: it is the hypothesis whose consequences are used to compute a test statistic, p-value, confidence interval, or related error rates. There is no null hypothesis for arbitrary philosophical debates. You cannot compute a p-value for H_0 that LLMs aren't conscious. You might be using "null hypothesis" informally to mean "default position", but remember this has no relation to its scientific meaning in inferential statistics and doesn't lend any scientific legitimacy to implying we should assume LLMs aren't conscious.
2. It's up to the experimental design to choose a null hypothesis. Yes, normally it would be something like "this drug has no effect", but it doesn't have to be. You could set up an experiment where the null hypothesis is that the drug you're testing is equally effective as another drug. There is no objective truth of what the null hypothesis needs to be. It's up to you and your test setup.
3. There is no requirement that the null hypothesis be likely. You and everyone else on Earth can believe there's a 99.99% chance that the null hypothesis of an experiment is wrong. Assuming you could set up a statistical experiment to detect consciousness, whatever you pick for your null hypothesis has no bearing on whether Ted Chiang or Anthropic is more justified.
> There's no good reason to suspect consciousness in LLMs
That's the entire debate. One side thinks there are good reasons to suspect consciousness and presents their arguments for that. The other side thinks there aren't and presents their arguments against.
What happened here is you judged the no-consciousness side to be more likely, but then you try to pass off your judgement as an obvious prior that everyone should share.
It would be fine for you to say you think LLM consciousness is unlikely. That makes it clear it's your judgement on the debate. It's fine for you to say you would require extraordinary evidence because your priors are so low. It's fine for you to say you think everyone who thinks otherwise is wrong.
But there is no reason for anyone who has judged the arguments differently than you to accept that your priors should be the default. There is no meta-level principle that you can appeal to here. If you want to show consciousness in LLMs is unlikely, you have to use arguments about the issue itself.
> Ted Chiang is taking the default and honest position: "no, LLMs aren't conscious. If you truly believe they are, show us the really scientific and rigorous proof."
That would be a bad faith, double standard. No one has ever shown scientific and rigorous proof that humans are conscious. Philosophers call this the hard problem of consciousness.
That aside, the honest default position to anything should be "we don't know for sure", which can then be followed by considering the evidence and estimating the likelihood. If you think the sun will rise tomorrow, that's only because we've gathered extremely strong evidence that it will. If today was your first day hearing about the sun and you know nothing else about it, you have no reason to think it will or won't rise tomorrow.
Anthropic has said they don't know if LLMs could be conscious.
Ted Chiang has said they are definitely are not conscious.