169 karma · joined August 24, 2013
1 cent cheaper would net Sony a total of 500K USD for all PS5 units sold till date. So about a hundred PS5 units at retail as pure profit. A company of the size of Sony for a product of the scale of PS5 would absolutely forego that profit if the alternative offered any tangible benefits at all.
May be a case of moving goalposts, but I'm happy to bet that the speed of movement will slow down to a halt over time.
Because, obviously, training data probably includes a decent amount of motivation breakdowns as a function of coercion.
It doesn’t know why, but it knows what to say.
The LLM boom of the last year (Open AI, llama, et al) has me giddy as a software person. It's a reach, but I truly feel like I'm watching the pyramids of our time get made.
I don’t want to entirely replace the data gathering + annotation workflow for everyone, but I believe that ready-to-go data can reduce the barrier of entry for ML projects, make _some_ people realize that they don’t really need their own data collection, and even help large businesses reduce their dependency on Scale / Appen.
I shook my head because they were similar and equally bad.
> That’s not at all his specific argument about self-driving cars (there were entire sections about the decision making issues he saw), but is the crux of his argument about AI as a whole.
I was talking about the crux of his argument, which starts by saying that we won't get self-driving cars because <start of bad arguments>.
> And there’s a whole article discussing some of those, if you read the parts in the middle. I don’t think the dude’s necessarily right, but I’m also pretty sure you missed a lot of the text in an apparent race to summarily dismiss it.
In my complete reading, the article was geared towards discussing the impossibilities (rather than possibilities) from the POV of someone who hasn't taken any time to understand the cutting edge of research that he is critiquing. That was, in fact, my original point - critique is great, but don't mask personal intuition (potentially uneducated) as science.
You’re bringing alignment to a capability discussion.
They raise philosophical assertions disguised as logical / scientific assertions.
> “Better.”
> That is a concept that cannot be made via cold calculation. A universe boiled down to particles and numbers cannot care whether atoms arranged as a suffering plague victim are “better” than those arranged as a healthy child, or a plant, or a cloud of gas.
It can, John. The engineers teach machines what's good and bad. That's the first step in creating silicon intelligence.
> It is impossible to understand pain without having felt it yourself; it does not convey as an abstract value. I think the machine needs to tangibly interact with human suffering in the same way the Roomba’s wheels need to physically touch the floor.
Pain is nature's deterrence mechanism, bred into us through evolution. Deterrence mechanisms can take many shapes.
> This leads us to the ultimate cosmic joke: This task requires answering for this machine questions that we ourselves have never been able to answer. Let’s say I’m right and this system won’t exist until we can teach it emotion, and the capacity to suffer. How long until it asks the simple question, “What is our goal, long-term?” Like, as a civilization, what are we trying to do? What are hoping the superintelligence will assist us in achieving?
I hate being disingenuous and make a flippant argument here, but reading this from start to finish makes me ask a bad faith question - your assertion is that we won't have self driving cars because we can't tell the robots what to do with the whole civilisation right away? There's a whole spectrum of amazing (or terrible) possibilities between the extremes, my guy.