HNHacker News
TopNewBestAskShowJobs

hackinthebochs

6,082 karma · joined February 12, 2009

submissionscomments
hackinthebochs··on The CEO of Mullvad is the main financer of the Swedish Örebro party
As it turns out you can't have strong socialist policies and also open borders.
hackinthebochs··on The CEO of Mullvad is the main financer of the Swedish Örebro party
I appreciate the candid response. It shouldn't be so hard for people to just clearly state the premises that motivate their beliefs.

>the burden should always be on the ones who are stronger to accommodate those who are weaker.

Is this a universal principle? Does this come with any limits at all? A salient example that comes up often: classrooms tend to have a small handful of extremely disruptive students that ruin the experience for everyone else. The current thinking is to not suspend/expel these kids because they are disadvantaged or whatever. But in doing so the other kids suffer greatly, not to mention the teachers.

How do you manage different dimensions of strength/advantage? It is the weakest in society (women, children) that bear a disproportionate burden of allowing large amounts of immigration from third-world countries. Why are the rights of women and children secondary to the rights of immigrants?

hackinthebochs··on The CEO of Mullvad is the main financer of the Swedish Örebro party
Why do people pretend they don't understand context? What do you get out of posting this irrelevant pedantic response?
hackinthebochs··on The CEO of Mullvad is the main financer of the Swedish Örebro party
Why is the burden always on the host nation and never the immigrants?
hackinthebochs··on Mullvad founder gave millions to extremist far right party
That doesn't answer the question. Identity does matter. Because Nazi Germany came to the wrong conclusion does not invalidate every premise used in their justification.
hackinthebochs··on Mullvad founder gave millions to extremist far right party
What epistemic value does "similar rhetoric" have? The relevant question is whether something is true and/or defensible. Identity does matter, to some nations and historical contexts more than others. It is silly to project the particulars of the US historical context to the rest of the world.
hackinthebochs··on Mullvad founder gave millions to extremist far right party
>You do not need to be Christian or believe in the rule of law to be American.

A comically bad faith reading of what I said. Clearly no point in engaging.

hackinthebochs··on Mullvad founder gave millions to extremist far right party
A country owns their home-grown lunatics. They have no responsibility for the rest of the world's lunatics.
hackinthebochs··on Mullvad founder gave millions to extremist far right party
>Why are you complaining about leftists who see immigration as inherently "good" if you can't even explain why it's bad? If it's so obviously bad, surely you can outline what will tangibly happen?

This is just a bad faith misrepresentation of the context. Note the context of the OP is Swedish nationalism.

> You aren't "easily recognizing" anything, you are having a feeling about people different from you and trying to rationalize it afterwards.

It's not really that hard. Some traits off the top of my head: speaks English, values meritocracy and the rule of law, individualist over collectivist, ecumenical/egalitarian over sectarian, culturally Christian or downstream of it.

> If immigration was so obviously bad, do you think a nation of immigrants would be able to get to this point?

This point only makes sense if you assume immigrants are an undifferentiated lump. But of course this isn't true.

hackinthebochs··on Mullvad founder gave millions to extremist far right party
Yes, some immigration is good. That doesn't mean all immigration is good. Are you willing to identify positive traits and limit immigration to those with those traits? Or do you balk at being selective? The defense of immigration always treats immigrants as one undifferentiated lump. But this is just the lumping fallacy.

>The "homogenous countries" started 2 world wars, one of them to "preserve their culture, ethnicities, identities". Would this not support the worldview that immigration has net benefits?

Oversimplification to the point of bad faith

>Also, can you explain how ethnic cleansing preserves culture and identities?

Obviously a disingenuous question

hackinthebochs··on Mullvad founder gave millions to extremist far right party
Yes, it is hard to pinpoint exactly what makes one an American. It is not hard at all to pinpoint what makes one an X for any given European nation. It is strange how much Americans project our weak identity to the rest of the western world.
hackinthebochs··on Mullvad founder gave millions to extremist far right party
You'll notice my mention of European countries in my comment. You might have guessed that my point about deep historical roots was in reference to that.
hackinthebochs··on Mullvad founder gave millions to extremist far right party
Thanks for replying. I can see your point of view.
hackinthebochs··on The CEO of Mullvad is the main financer of the Swedish Örebro party
>I believe they belong here as much as I do.

This sentiment is just so utterly foreign to me that I can't comprehend how someone could rationally think this way. I mean, I'm a black man whose ancestors have lived in America since the slave ships, and I easily recognize that some people are more American than others. And Americans only have like 1% of the cultural and ethnic identity that most European nations have. Why are you blind to the importance of the deep historical roots that bind a nation together? Why do you think the very force (namely kinship ties) that has driven humanity forward for the last hundred thousand years has, in the blink of an eye, become irrelevant?

hackinthebochs··on The CEO of Mullvad is the main financer of the Swedish Örebro party
Not in my experience, at least not at the national level. It's been said that Obama deported more illegals than anyone that came before. But Democrats couldn't run on that record because it was toxic to the progressives.
hackinthebochs··on Statement on US government directive to suspend access to Fable 5 and Mythos 5
That's not how nerds think. You can believe there's a high chance of what you're working on being dangerous and still be unable to stop working on it. As Oppenheimer put it, "when you see something that is technically sweet, you go ahead and do it".
hackinthebochs··on What is it like to be a bat? (1974) [pdf]
>But why does engaging with negative valence, planning, and weighing actions against other interests require subjective experience?

I have a few different answers here. None are rock solid. Lets take it as a given that planning requires a unified representation of all inputs to the planning apparatus. Now, going with the example from earlier: an organism touches a hot stove and recoils. We can imagine this behavior without any accompanying qualia. But to plan subsequent behavior around the hot stove, the damaging hotness must be represented in the unified representation in a way that intrinsically carries the semantics of negative valence. Phenomenal pain just is "semantics of negative valence featured in a unified representation". My claim is that this is a conceptual identity; you can't have one without the other. This gives the planning apparatus competence at engaging with signals of bodily damage.

Without intrinsic semantics/phenomenality all you have is a signal with no intrinsic meaning and some context to select behavior downstream of the signal. But planning in dynamic environments requires much more flexible signaling than this kind of static context can provide.

>AI systems weigh negative valence and execute long-term plans without any qualia.

AI systems are highly fragmented representations. It's why you can get them to contradict themselves in the same session, or even one sentence after another. They are not an exemplar of coherent behavior. There's also no negative valence in LLMs. At most they have a representation of good/bad and this spectrum influences the valence/quality/alignment in their behavior. But valence as such is external to the LLM.

>consider that there are many examples in which humans are able to perform very complex tasks in the absence of qualia. Consider, for instance, the phenomena of highway hypnosis, blindsight or sleepwalking - humans can do incredibly complicated things without qualia.

Complexity is relative. The complexity of tasks sans qualia are always starkly deficient compared to comparable tasks with qualia. A wide look at cognitive science demonstrates the inherent value of qualia to highly complex tasks or tasks executed over long timescales.

>This argument is circular. The original claim is that behaving coherently in a a complex environment requires consciousness. By shifting the goalposts...

The goalposts aren't shifted, I'm clarifying the target of the term behavior as there was clearly a disagreement in meaning.

>to say that only voluntary behaviors qualify, you are begging the question. The entire notion of "voluntary" implies conscious intent, so your argument has become "consciously willed behaviors require consciousness".

This misunderstands the debate. The philosophical issue of consciousness is how to explain consciousness given the in principle completeness of physical descriptions and their categorical distinction from phenomenal descriptions. In this context, voluntary behavior is just higher order/complex behavior, it is not taken as downstream of consciousness in principle. There is a parallel conversation in psychology/cognitive science where consciousness is largely understood as wakefulness, attention, reportability, intentionality, etc. In this context "consciousness" (in this restricted sense) is a pre-requisite of voluntary behavior. But that's neither here nor there with regards to the philosophical debate.

hackinthebochs··on What is it like to be a bat? (1974) [pdf]
>But this isn't true! It has been repeatedly shown that patients without inner brain function react to stimuli (such as being pinched or pricked with a needle) by recoiling from the pain, as do babies with no experience of pain.

Yes, reflexive avoidance behavior doesn't require conscious experience. But as the environment of the organism gets more complex, reflexive avoidance behavior isn't sufficient for competence. For an agent in a complex environment, competent damage avoidance requires engaging with negative valence as a cognitive entity to be planned around and weighed against other interests. This requires unification and consciousness.

>Another counterargument is that our brains carry out lots of "coherent" functions "in the dark". Consider, for example, thermoregulation

This isn't an example of coherent behavior in the sense being used here. The issue is one of voluntary behavior being coherently executed as to achieve some goal without undermining itself.

>do you believe that a thermostat is conscious?

No. No self model, no consciousness.

hackinthebochs··on What is it like to be a bat? (1974) [pdf]
Presumably the question you're asking is why does a unified self representation require consciousness. (Split brain cases are easy examples of how a break in unification results in incoherent behavior.) The brain nominally performs functions as cascading behavior of atoms whose structural relationships correspond to various functions. But there is no unification at the unconscious/atomistic level therefore a new representational regime is required that can ground the higher level unification.

A successful organism exhibits a high level of competence at reacting appropriately to environmental/sensory states. The "light's being on" is how the brain represents being situated in a world and the significant features therein. Representations within this gestalt are inherently meaningful. For example, phenomenal pain brings with it competence at protecting bodily integrity. The memory of pain becomes part of the explanatory narrative for the monitoring function that tracks progress towards goals ensuring coherent behavior (imagine being fearful of a stove but not knowing why). The contents of consciousness is the semantic engine that induces competent behavior over time on otherwise naive entities.

hackinthebochs··on What is it like to be a bat? (1974) [pdf]
My usage of gestalt isn't without precedent[1]. I like gestalt better than qualia as a neutral description of the explanandum. Qualia is an atomistic view of consciousness and so is heavily theory-laden. I had just read a comment from the previous thread[2] on how this paper was translated into other languages and the lack of an equivalent "what its like" phrasing. The translations struck me as missing the virtue of the what it's like phrasing, namely identifying the intrinsic perspectivalness of cognitive systems without taking a stand on how to cash it out. I was trying to think of a better phrasing that could translate well and I landed on gestalt.

[1] https://philpapers.org/archive/EPSGPA.pdf

[2] https://news.ycombinator.com/item?id=45120638

hackinthebochs··on What is it like to be a bat? (1974) [pdf]
Try sending an email to their contact address (bottom of page). Unless there's a good reason your comments are being auto killed, they will fix it.
hackinthebochs··on What is it like to be a bat? (1974) [pdf]
> It seems difficult to claim that the computational process that implements this has any more or less of a gestalt then one multiplying two matrices together. So it's not just the existence of certain representations or computational loops that seems to lead to possessing a gestalt.

I've thought a lot about what is lacking in modern VLMs that preclude consciousness. In my view the difference is that their talk of "self" is a simulacrum of the real thing. Current models are feed forward and so self-talk is driven by some parameter that turns on when the network detects context that possibly references the model, and this parameter drives downstream self-talk. It's a very good simulacrum, but it is a far cry from a model with recurrent self-reference around which the inference process is organized. The richness of the self-model in a hypothetical recurrent network with capabilities of modern LMs is much greater than the parameter on/off representation in feed forward networks.

hackinthebochs··on What is it like to be a bat? (1974) [pdf]
Seems like a rather ad hoc restriction. The issue is one of inferring the structure of the processes generating the output. I suppose given enough time and an adversarial style of interaction one could in principle determine the computational structure of any system with high confidence. So probably yes, modulo real-world concerns.
hackinthebochs··on How LLMs work
>Are you arguing that with a set of identically-behaving black boxes, one could be "reasoning" and one could be "not reasoning", and a person would need to look inside the boxes at how they function to decide?

Absolutely! Inside one of the black boxes could be an audio device replaying a tape. The other could be a person thinking and responding. The massive lookup table construct people like to reference is just another kind of recorder, it takes every possible conversation that could happen in some finite sequence of characters and produces the precomputed continuation on demand. No one ever asks where those conversations came from. If God has to imagine them in his mind, conversing with the lookup table is just conversing with God.

hackinthebochs··on What is it like to be a bat? (1974) [pdf]
What it's like - the gestalt of a bat (or other thing) as it engages its sensing-deciding-reacting loop. This gestalt isn't just for biological organisms, but any system for which its decision making engages with representations of the external environment unified with a self-representation to form a coherent representation of a persistent entity engaged with an external world.

Why do such systems need this gestalt? Why consciousness instead of everything happening in the dark? The recognition of oneself as situated in the world is crucial to coherent engagement with the world. It is how an entity can ensure its body parts are moving towards the same goal. It's how behavior over time doesn't undermine its purpose. Fragmented, incoherent behavior does not serve self-preservation.

LLMs as they are currently constructed probably aren't conscious, but we are a hop skip and a jump away from ones that are.

hackinthebochs··on How LLMs work
>I say they're equivalent because it is possible to losslessly convert one to the other by wasting massive amounts of disk space and time.

There is a classical algorithm for every quantum algorithm if you're willing to waste a massive amount of space and time. There is a finite-state automata that can recognize any string some Turing machine can recognize. Yet we recognize these as distinct classes of computation. Mathematicians can get away with ignoring the tractability of finding an object with such and such properties. The rest of us can't.

Sure, there is a formal equivalence between LLMs and Markov chains, and this formal equivalence is useful for analysis. But this equivalence is not a constraint on the nature of the computations LLMs are doing. The formal equivalence does not mean that LLMs are "just predicting the next token". A probability distribution is a formal characterization of the statistical relationships between inputs and outputs. But this formalization does not undermine potentially further structure underlying the probability distribution (e.g. a deterministic mapping from inputs to outputs).

>if the transformer is reasoning, so is the hash map built from it.

Definitely not. "Formal" reasoning is making deductions based on the "form" or shape of some statement. In other words, transitioning from some token sequence to another sequence in virtue of the semantic structure of the token sequence (as opposed to its semantic content). Thus a necessary condition for reasoning is the ability to inspect the structure of the input rather than see it as a formless blob. Transformers can plausibly do this; lookup tables, Markov chains, etc necessarily cannot.

>For the record, "X is more expressive than Y" means "there exists at least one thing that Y cannot represent and X can".

Maybe expressive is the wrong word. But when a model has to wait for someone else to do the work then copy the answer, I call bullshit on it being (computationally) equivalent.

hackinthebochs··on How LLMs work
That paper doesn't prove the equivalence of Transformers and Markov chains, it uses Markov chains as a theoretical model to understand the behavior of Transforms. The expressivity of the model matters, and Transformers just are more expressive than Markov chains.

>but the same tokens in two different orders are two different lookup keys

This is necessarily true for Markov chains and not necessarily true for Transformers. Transformers learn invariance over certain kinds of semantically irrelevant transformations. The Markov chain simply has to learn each input variant independently, resulting in an explosion of state space and data requirements compared to the functionally equivalent transformer. Expressive power matters.

I really don't get people's love for saying X is "just" Y (it's just a Markov chain, it's just a Kernel method). It's a strange pathology to focus on the superficial similarity while downplaying the boost in expressive power from where the models diverge.

hackinthebochs··on How LLMs work
>In other words, a Markov chain and a Transformer model are exactly equivalent in power

Nonsense. Markov chains treat the past context as a single unit, an N-tuple with no internal structure. LLMs leverage the internal structure of the context which allows a large class of generalization that Markov chains necessarily miss.

hackinthebochs··on How LLMs work
>The point is that the output is text that is statistically correlated with the input.

But we can simply note that this description applies to any machine learning algorithm. Yet LLMs are lightyears better than, say, Markov chains. What people are after is something that elucidates the features of LLMs that allow them to be so productive over what came before.

hackinthebochs··on How LLMs work
>At all times the LLM is, indeed, predicting the next token

The point is that saying they're just "predicting the next token" is not at all explanatory nor providing insight. Saying the brain is just firing action potentials gives you no understanding about how the brain does what it does or what the space of its capabilities are. Similarly, predicting the next token tells you nothing about the capabilities of LLMs.

← PreviousPage 4 of 34Next →