825 karma · joined October 21, 2021
I do not believe this is true in the slightest. I learned more in a single OS class than i learned in years of industry work. What you learn in industry tends to be distinct from what you learn in college, and if it isn't, then your college curriculum was probably a waste.
Decoder: Fixed representation vector + N decoded text tokens -> N+1th text token
Encoder/Decoder architecture: You take some tokenized text, run an encoder on it to get a fixed representation vector, and then recursively apply the decoder to your fixed representation vector and the 0...N tokens you've already produced to produce the N+1th token.
Decoder-only architecture: You take some tokenized text, and recursively apply a decoder to the 0...N tokens you've already produced to produce the N+1th token (without ever using an encoded representation vector).
Basically, an encoder produces this intermediate output which a decoder knows how to combine with some existing output to create more output (imagine, e.g., encoding a sentence in French, and then feeding a decoder the vector representation of that sentence plus the three words you've translated so far, so that it can figure out the next word in the translation). A decoder can be made to require an intermediate context vector, or (this is how it's done in decoder-only architectures) it can be made to require only the text produced so far.
Like a lot of people here, I have family who died in the Holocaust. It is highly likely that the camps they moved through were using tech supplied by IBM. Would it have been "culture warring" for tech employees circa 1938, to publicize the human rights abuses being enabled by their companies? Because that's what the people who support these protesters think is going on here.
1. The belief that Israel is the homeland of the Jews, and by extension, my homeland.
2. The belief that Israel should remain, legally, a Jewish supremacist state, where only Jewish sovereignty is recognized.
I disagree strongly with both of these notions.
The conclusion I come to, which doesn't actually seem that strange, is that what's special about our experience is the complexity of our thought, our ability to turn extremely high-dimensional raw experience into low-dimensional models of reality, our ability to maintain a sense of mostly-stable identity over a long period of time, our capacity for emotion and sensation. It may "feel like something" to be a rock or a standing desk, but it isn't a very interesting or complicated feeling.
This problem just goes away if you assume that there is no dividing line between the "experience" of you and the "experience" of any other computational system. Actually try to think, what does a computer "experience"? An atom? What does it feel like to be a standing desk?
Empirically, societies that employed violence for their own benefit (e.g. the British, the French, the Americans, the Israelis) seem to have suffered very few consequences, whereas the societies that have employed violence to remove them (e.g. the Chinese, the Haitians, the Iranians, the Palestinians) have done very poorly in the aftermath. While there are certainly some negative consequences for strong countries which violently impose themselves on the weak, (e.g. Americans pay for their Middle-East policy by having to take their shoes off at the airport), on the whole it seems like a successful invasion, however bloody it may be for the country invaded, tends to cause relatively few material problems for the invader. If there's any repayment for evil, it must happen in heaven and hell, because hardly anywhere is justice visible on Earth. Like Thucydides said, "The strong do what they can, and the weak suffer what they must."