Is human behavior just elaborate running and tumbling?
nathanieltravis.com
nathanieltravis.com
> Why are some people willing to free solo climb icy mountains despite the danger?
> Why are some people willing to have fewer children in order to pursue career goals?
> Why are most billionaire tech CEOs interested in space travel and extraterrestrials?
> There are no doubt potential evolutionary explanations for each of these phenomena.
No doubt?
> But, from a purely evolutionary standpoint, these phenomena are at least (a) not obviously explained or (b) seemingly irrational.
Correct.
Many phenomena have an evolutionary explanation. However some phenomena do not - random mutations happen and things pop into existence without much connection to mating, survival etc. Trying to shoehorn evolutionary narratives onto them is not letting the evidence fit the theory, but instead trying to get facts to fit some preexisting theory.
Some traits just pop up due to random mutations, and trying to find an evolutionary mating/survival/etc. narrative for each of them does not make sense.
So (at least from my armchair) it's no wonder we see more "pointless" behaviors.
If anything our tendency to not have reproductively isolated subgroups and large population is making speciation less likely. But rest assured our genome is slowly changing as we change our fitness landscape.
> Why are some people willing to have fewer children in order to pursue career goals?
The obvious explanation here is that there wasn't really birth control when humans lived as hunter-gatherers. You couldn't make that kind of sacrifice for the most part. There also weren't really careers in the modern day sense. Evolution hasn't had a chance to account for birth control yet. It's only been around for 60 years or so.
> Why are most billionaire tech CEOs interested in space travel and extraterrestrials?
Because all life has some instinctive drive to explore and spread. By exploring, you have an opportunity to find new resources and territory, which is essential for survival or to outcompete other life.
> Why do some “gym rats” build their muscles well past the point of being a way to attract potential mates?
When humans lived as hunter-gatherers, there were no gyms and no muscle building magazines, no cult of bodybuilding. For the most part, you got as fit as you needed to be to hunt animals, to fight, and build whatever you needed to build.
However, I think the part about being "well past the point of being a way to attract potential mates?" is a value judgment. In actuality, growing a lot of muscle mass is a way of showing off your determination and fitness and standing out. Male bobybuilders probably have a much easier time attracting mates than the average joe.
> Why are some people willing to free solo climb icy mountains despite the danger?
Evolutionary drive to explore. Evolutionary drive to show off prowess to attract mates and gain status. It's a high risk, high reward strategy.
There is a top-level algorithm of "find mate and reproduce", which is enjoyable. How does it boost the odds? By doing things to be more attractive, for example. But how does one "know" one is on the right path? Activities which we learn increase attractiveness are enjoyable. There's a gradient we follow. More attractive = more enjoyable. So you end up with complex behaviors that basically become self-hoisting; the activity itself becomes the reward.
Basically, games and hobbies. Something becomes enjoyable vis a vis various learned reward functions, so we just pursue the enjoyable thing.
There's also a meta-loop wherein staying mentally stimulated and curious is itself a useful fitness, so we do things which are interesting, because it's enjoyable to do that.
I think one thing to remember here is that while for sure attracting mates must play a role in the appeal of bodybuilding, there's also a competitive game aspect. You can compete against yourself and your peers. This can appeal to instinctive drives to compete and gain status, maybe again past the point where it's reasonable in some cases (are you really winning at life, gaining something meaningful by doing this?).
If we just talk about the attracting mates aspect of bodybuilding, we also have to remember that if a man is trying to attract women by gaining muscle mass, his idea of what women in general might find attractive is just an approximation. Maybe this man found that he was gaining more attention from women when he started to gain muscle mass, so he just keeps doing more of that. Eventually he might gain even more attention for other reasons (improved self-confidence), but it gets hard to tease apart the real causal factors.
In my own life I think of the sitcom "Head of the Class" as a kid. Basically, painted "nerds" and computer geeks as highly sexually undesirable. All signaling was that this is what not to do to get laid.
Didn't even take 25 years for that to essentially be reversed to the point of a computer geek being a type of peacock feather to flaunt and strut around.
IMO the point we are maladjusted for the environment we live in is highly overblown.
I'm no anthropologist, but I'm pretty sure various forms of birth control have existed for at least several hundred, if not several thousands of years. Granted, the invention of the birth control pill was a pretty big milestone, but it's not like nobody had ever thought of ways to fuck without getting pregnant before then.
Entertainment for boys has way more muscles in it then entertainment for teenage girls. Boy bands tend to be those thin, slim dudes too.
"Individual organisms are best thought of as adaptation-executers rather than as fitness-maximizers" -- John Tooby and Leda Cosmides
This seems like an extraordinary claim. I can get behind the idea that it’s possible for a random mutation to impact personality traits. It is entirely different to turn to this as a general purpose mechanism for things that are hard to explain. It seems overwhelmingly likely that most traits are in some way selected for, because useful traits are naturally more likely to propagate than random useless (which will pass on, or not, at random)
Preferring Pokemon over Halo doesn't entirely reduce to one's genes. Being too busy to have kids is situational and part of a complicated modern life. There is genetic contribution to these outcomes, but we're well past the point of genes being the most complicated factor. Now you have to model society and a person's random walk through it.
What you described is just “nature vs nurture”. Genes don’t make anyone prefer Pokémon over Halo directly, but the mechanism was built by evolution. A person who makes friends playing Pokémon is certainly likely to develop a fondness for Pokémon, because having friends is beneficial to survival and reproduction.
Maybe this is an interesting position for software, because modern CPUs are explicitly intended to be general purpose and as such are all theoretically equivalent. Even there the abstraction falls apart pretty regularly, though, as Intel gets destroyed by M1 battery life and attacks like rowhammer affect some hardware far more than others. It’s only post Harare as long as the hardware it’s good enough for the purpose.
Phenotype, whatever.
> It’s only post Harare as long as the hardware it’s good enough for the purpose.
Most human brains and bodies are good enough for most human purposes. Sure, there's large variation between humans, but the variation between populations isn't great enough to be significant, as far as I'm aware.
The difference is that we know how general purpose computers work. We literally know exactly how they work due to the fact that we built them, but also we have developed very useful abstractions for how to use them. We do not have an equivalent understanding of human behavior.
Humans are not general purpose computing devices that we know how to program. Humans are extremely complex systems that are already running software and we don’t understand that software. We’re engaged in black box debugging and we are nowhere close to actually understanding the software running on the box (and we’re little closer to understanding the hardware).
Also, I wasn't trying to equate computers and brains, or ideas and software. I just picked the example to show how “post-genome” can make sense as an idea. It's not an applicable analogy.
Let’s go back to your original comment:
> Modern computing is “post hardware”. That doesn't mean the hardware doesn't matter, or that changes to the hardware don't make a difference; it means describing the hardware is insufficient to describe computers, whereas describing the software is mostly sufficient.
You are correct about software. Describing it is largely sufficient to explain computer behavior.
This is not the case for human behavior. The genome encodes the hardware, but also encodes a ton of critical software (call it firmware?). Even basic needs like eating are not explained by culture/society. More complex behaviors called out in the article are also not explainable solely by cultural influence. Certainly culture influences the gymbro to build muscle, but it cannot be solely that because most people do not build massive amounts of muscle. If culture were solely responsible you’d expect to see this influence people far more evenly. Same for climbing mountains. There’s very little societal push for this. And I mentioned weddings already. You can certainly explain the specifics of weddings culturally. But you cannot explain why people desire to pair bond culturally.
We’re not post genome because we cannot explain most human behavior by looking solely at cultural influences.
I'd like to add (a bit off topic) that humans are not necessarily capable of causal reasoning, at least not alone. It's a cultural process where the true causes are separated from correlations in time, with lots of experimentation. Only with special training and in specific domains can we reason causally, and most population just learns the surface never getting to real understanding. In that regard we're like language models.
So part of what makes us so smart is not in the brain, it's culture itself. If you observe feral people - they never get far on their own.
Could this be one of the great filters that we, as a species, still need to pass?
I don’t know what you mean here. The specific traits mentioned (building muscle past the point of attractiveness, climbing deadly mountains)? Traits in general? Something else?
> Imagine saying that linguistic components are naturally selected for in the genome. It's the wrong level. Language happens at the level of brains and societies, not genes.
It’s not the wrong level. From what we can tell, other animals are literally incapable of complex language. That’s genetic. Language traits literally have been selected for in the human genome. We have a brain that can process language and a tongue structure capable of making complex sounds that other animals can’t apparently replicate. Certainly language also has environmental/societal components. But it’s inaccurate to say that it’s not also genetic.
Unless you mean that literal languages are not genetic, in which case, sure. There’s nothing in the human genome that encodes English. There’s also nothing in the human genome that encodes the taste for yogurt, or the drive to be the fastest runner, or the Catholic wedding ceremony. And yet genetic components still certainly underly those in a meaningful way. It’s worthwhile understanding the genetic components even if they cannot explain the entire phenomenon.
It’s conveniently tautological because it’s impossible to prove or disprove without time travel :)
A more interesting conversation which is also impossible to prove/disprove is whether there is any behavior that isn’t just behavior/instinct. It sure feels like it with consciousness, but if humans are weights and biases, it was inevitable that I typed this :)
There is evolutionary fitness at an individual level, but cultures have evolutionary fitness as well. A culture might preserve individuals that have low individual fitness because they create cultural fitness.
For example the need to explore and expand the boundaries of knowledge may not be useful at an individual level, however a culture with those individuals might survive better than a culture without. All members of the culture that does not have those individuals may die, even if individuals are very fit.
Sociopathy is likely conserved at a cultural level because cultures periodically need sociopaths to completely obliterate competition or ruthlessly compete to survive.
Cultures also are constantly spawning mutations (civil rights, black lives matter, nazi ism, capitalism, democracy. social justice etc) those mutations can be positive, negative or neutral. Neutral traits can hang around if they carried alongside traits that do provide cultural fitness.
Past that point you just get whatever random sexual selection criteria emerge, and the ensuing feedback loops
Same reason the world is full of brightly colored loud-ass birds
e.g. i blast it at the gym (i dont actually but play along ;)) and i build an abstraction of life that that is part of. the fact that the abstraction has limitations is irrelevant. we dont process the real world we process our learned abstracctions of it.
Oddly compared to my cohort I am both a nerd and a jock. I find intense exercise be it hiking or cardio or weights helps me keep my sanity in terms of sitting all day and the other stresses of my work. It's not like it is abstractly good for my health in the long term and I'm discovering now that it probably wasn't but that I feel better immediately in the short term from physical exercise.
Atomic Habits touches on this. People think that I have all this discipline to get up and workout, but the reality is that I enjoy getting up early and working out. I enjoy training JiuJitsu and more often than not getting my ass kicked. I can't really explain why, somewhere along the way I associated feeling good with hard physical work.
I wore a heart monitor for a month and we observed about 30 seconds worth of AFib right at the very end. (Oddly I had experienced a very interesting setback in my personal life around then.)
I had the signs described above. My doc said I should go on exercising but I shouldn't train more than 1 hour a day. (In a time when my life went to crap I had got into the 2 hours a day habit to fight my depression.)
It's an interesting problem for competitive athletes (say Serena Williams) who might not play as hard since the risk of concussions are worse if you are taking anticoagulants.
And I'm also sure many will also have encountered that moment when you have really focused and dug deep into a problem and hit an impasse, then force oneself to take a break and do something completely different, and in the midst of it all, "aha!"
Human backs are maybe a good simple example of this: walking upright has been great overall, but has a lot of drawbacks that we suffer from such as difficult childbirth, back problems, etc. You could ask "what is the evolutionary advantage of lower back pain" and the answer of course is there's none, but there is still a broader explanation that makes sense when you consider the whole system.
To add to what you said, though, I don't think of these phenomena in terms of random mutations. In other words, I don't think of these people as anomalies that do anomalous things; moreso, I think of it as following our growth imperative (i.e. the expected reward gradient), which, if we follow it long and hard enough, can lead to behaviors that appear anomalous.
One commenter below (kortex) really hit on what is at least my interpretation when he said "we are basically seeing an implementation detail come to light."
The only way to get everything you'll ever want, is to want nothing.
> Why do some “gym rats” build their muscles well past the point of being a way to attract potential mates?
Margin of safety. Many would probably disagree with the author's assessment that they're well past that point.
> Why are some people willing to free solo climb icy mountains despite the danger?
Conquering new land is deeply embedded into our psyches for evolutionary reasons. The species that's not afraid to do that will probably be more successful in the long run. Conquest of more land is generally correlated with better survival chances.
> Why are some people willing to have fewer children in order to pursue career goals?
Perhaps many, like myself, are aware of how expensive kids are but unaware of how difficult having kids gets later in life. So they optimize this wrong. I wish I had started earlier, but I put it off until later because I thought I'd be able to provide for them better. This thinking was correct, but having them earlier would still have been better, for me at least. The point is, it's certainly not due to a lack of evolutionary interest in having kids.
> Why are most billionaire tech CEOs interested in space travel and extraterrestrials?
See conquest of land above...
Overwhelming majority of people stay where they are. Generally humans need huge practical motivation to conquer lands.
Plus, interpreting climbing as conquering lands is super odd. It has more to do with any other sport achievemt then anything else.
Probably because once they start building their muscles, they compete in their minds with other gym rats and it becomes a vicious cycle.
And also: ads, social media.
Being a gym rat is not a heritable trait, but the ape who keeps doing whatever they were doing that made them strong and sexually desirable could be much more evolutionarily successful than the ape who stopped and became weak and undesirable. More generally, a positive feedback loop for beneficial behaviors is a desirable trait.
> Why are some people willing to free solo climb icy mountains despite the danger?
Being a free solo climber is not a heritable trait, but exploring your environment and incrementally pushing one's limits are both desirable traits. The ape that doesn't know which rocks he can climb falls to his death, the one who knows where to place their hands survives to reproduce.
> Why are some people willing to have fewer children in order to pursue career goals?
Corporate ladder climbing is not a heritable trait, but investing more resources in fewer offspring is advantageous when the odds of those offspring surviving are high. Even with no kids of your own, you pass on your genes through nieces, nephews, etc. The desire for resources has obvious evolutionary benefit.
> Why are most billionaire tech CEOs interested in space travel and extraterrestrials?
Neither being a tech billionaire nor being interested in space is a heritable trait, but the desire to explore is undoubtedly a desireable trait. The apes that expand into virgin territory can acquire more resources and become more resistant to local catastrophe than the apes who remain in one location. Elon Musk just has much better odds of becoming king of mars than I do. 500 years ago this may have manifested as building big ships instead of big rockets.
Of course random mutations happen, but those random mutations get eliminated quickly if they are harmful and spread quickly if they are helpful. Saying something is just due to random mutation is not only an unsatisfying answer, it is the answer to the wrong question: it doesn't matter why we started doing it, why do we still do it? Evolution doesn't create any trait, it merely perpetuates or fails to perpetuate them.
Not all behaviors are hardcoded into our DNA, certainly not at the level of specific actions we typically take day to day - my ancestors did not pass on their genes more successfully because of their affinity for arguing on the internet - but those traits which are heritable are unavoidably influenced by evolution. Evolution is the null hypothesis - if a system left to its own devices would do something without any external intervention, why invoke any additional explanation? It is those saying that something is genetic but which has somehow defied evolutionary pressure which are asserting a narrative, and who must show evidence in support of that narrative. Some narratives are legitimate, for example the traits of domesticated plants and animals aren't explained by natural selection; but oftentimes it is just "magnets, you can't explain that!"
Play is important for social cohesion.
Some traits might just present themselves as {seemingly nonsensical activity} in an industrialised world. Where back in time, these same people might have an advantage in {seemingly sensible activity}.
This does not preclude random traits being passed on, it is merely another way too look at things.
> and trying to find an evolutionary mating/survival/etc. narrative for each of them does not make sense
It is also a very lazy and uninteresting line of thought.
Of course {trait} had en evolutionary advantage. Why else would it be here? And if it is indeed random, then it may be of slightly more interest, but tells me very little.
We’re observing shadows cast against a wall. Eagerly pointing out this and that pattern. When the interesting part is knowing the individual shapes that make up the dancing display.
The idea that humans are goalseeking systems motivated through a single parameter of dopamine response seems like it might be reasonable enough, but that then just moves the problem around: how is a particular set of stimuli + past stimuli linked to a dopamine response?
Furthermore, are they intending to force all behavior analysis through a control system with a single parameter? Can we ask questions like "what is the frequency response of the dopamine system?"
Essentially, if dopamine can be boiled down to a single lever, then I think that lever has as many buttons as a Formula 1 steering wheel.
There's actually 5 main subtypes of the dopamine receptor. They express in different concentrations in different brain regions, and have different functions.
DRD2 is kind of the heavy lifter when it comes to goal seeking. If you had to boil it down to one idea, I'd call it "go/no go". It might be tempting to try to map D2 to something like a coefficient, perhaps even the "run coefficient" in run and tumble. But it's not at all like that, even on its own. It's very nonlinear. Furthermore, the action of D1 modulates D2 in a concentration-dependent way. So you have not just D2 signaling, D1 signalling, but also the differential signal as well. We don't know exactly how it maps out, but we know it plays a roll in weighing risk/reward ratios. Screwing with this pathway often results in "low risk low reward" mild manner folks switching to "high risk high reward", often going into gambling, manic spending, hypersexuality, and grandiose thinking. This can be seen occasionally with e.g. Parkinson's drugs such as L-DOPA.
Actually my headcannon is there are some parallels between Parkinson's and control theory. Net loss of dopaminergic neurons results in lower bandwidth on your control loop. In PID loops, one of the symptoms of insufficient I/D gain is ringing, where the controller constantly hunts for the setpoint and overshoots. Tremor is a common symptom of Parkinson's (though it affects much more than just tremor), but if you notice, it's usually not a continuous tremor, it's only when trying to execute motor control, especially fine motor control. The body knows kinematically where it wants to be in space, but the feedback loop rings constantly as it isn't able to get sufficient bandwidth to error correct.
Anyway, I think the point of TFA is not to suggest that this loop is a single parameter, it's just to model it as such. It's a spherical cow reduction. That kind of reduction lets you build practicable theories and test hypotheses. Such as: if Parkinson's is the result of reduced bandwith, can we treat the symptoms by increasing dopamine gain? And in fact, we can, that checks out.
A bit more tangential, but the article really falls apart when the author starts talking about examples related to humans, using the careerism of current middle class society as an example (The notion of a “career” is actually pretty recent from an anthropological perspective! Those anecdotes about hierarchical milestones and pushing ourselves for career advancement has more to do with the culture and ideology of today’s world than any other weird evolutionary/neurological reason!)
… and I’m not convinced. It’s basically claiming that maximization of entropy over all possible paths in a time horizon leads to emergent cooperative behavior in some kinds of simple toy puzzles, but then claiming it as the center of human cognitive behavior is a far stretch.
It's far from being _proved_, but the more I've thought about it the more it seems to intuitively line up with other systems of behavior optimization
But yes, its actual application to, say, social psychology has not been rigorously (or even partially) established.
I have a fantasy that a grad student or two will go down this rabbit hole to see if it can be used to build models that hold water. But so far I haven't seen anything.
A thing that the author glosses past is the relationship between having a model of the world and maximizing rewards. It's taken as given that a model-based approach leads to better predictions about rewards ... but when we try to get systems to actually solve problems, this often isn't the case. Learning policies which yield high rewards is often easier than learning a model which actually describes the environment. I think of value iteration as learning "I feel this is a good state", policy iteration as "I feel this is a good action", and a real model as implicitly providing "I think this is a good action because I expect that ..."
If artificial systems have the greatest successes with model-free approaches following algorithms very similar to the one the author describes, but humans seem to have a rich model _and_ do better than those artificial systems (at least accounting for data efficiency), doesn't that at least suggest that we're thinking differently?
Also, now that I think of it, although we often talk about how much more data-efficient humans are compared to ML models, we could say that we're actually much more data-inefficient than most (or all) other animals. Our gestation period is long and then we're totally useless as a baby. We require a lot of learning and development early on in order to reap the benefits later (which consist of generality and flexibility like you mentioned and also, for example, being able to generate our own synthetic data via imagination and counterfactual reasoning).
It sounded like it was still reinforcement learning, though.
But, it's not surprising to me that a mathematically simple, yet provably convergent algorithm appears over and over. For example, reward maximization in repeated bayesian games looks a lot like "Run and tumble", once you add this critical step (from OP):
> When a “tumble” occurs, rather than sampling a new direction from a uniformly random distribution, we sample according to the distribution of expected rewards
You may want to read the book Algorithms to Live By, also.
This should be expected though, as neural net ML practices are a direct descendant of cybernetics, and are essentially an attempt to digitise natural adaptive control systems.
* you can reasonably analogise a single sensor/effector control loop as gradient descent against a 1d state.
I may have some of the exact terminology wrong here (whether 2in-1out is considered 2d or 3d for instance) - my interest is in cybernetics generally not gradient descent specifically - but hopefully you get the gist.
The problem I have with their argument is a lot more philosophical: it all boils down to the validity of the reward hypothesis (http://incompleteideas.net/rlai.cs.ualberta.ca/RLAI/rewardhy...), and how we even define “intelligent” behavior. I’ve written another comment somewhere in this thread for more detail.
The K&A paper does mention the connection with RL: "Here, we consider the function of the circuit from the point of view of navigation, a connection anticipated by early work on TD learning (Montague et al, 1995)" (specifically, Montague et al found this connection when building a model of bee foraging).
It's so vague and general of an idea that it's almost a truism. I don't think it provides anything meaningful in regards to figuring out the actual complexity of human behavior both individually or collectively.
And I think this kind of over-generalization that is a little bit vapid has been a trend because there's simply not been a lot of theoretical progress when it comes to the functioning of the human mind.
When people use this kind of thinking to apply it to artificial intelligence I always think, why not just ditch intelligence and build a physics simulator? Clearly intelligence is somewhere in the subspace of simulating the physical world, so why bother? It doesn't add much to understanding anything in particular.
If you do make it that far, there is a payoff, though. This "trivial kind of system" isn't merely an analogy but the actual algorithm that we use, and the "implementation details" of this algorithm manifest in unintuitive ways that have a lot to say about how psychology is understood in general. Though, given your skepticism, more research will likely have to be done before this is satisfactorily proven to you.
This breakthrough (which I'd say is primarily K&A's breakthrough that I merely am speculating on top of), is actually a great example of theoretical progress. I typically consider myself an anti-reductionist, but this is a lesson in how studying simple systems (in this case, chemotaxis), can lead to better understanding of complex systems (because, well, it turns out at least in this case that these complex systems are actually the same simple systems at the top level—the complexity gets added in "layers" much like the evolution of brains).
In his human examples, all the "tumbles" are conscious decisions made by the person in response to their circumstances.
If there was some human equivalent of the "tumble", it would have to be something that was change just for the sake of change. Like: "I'm bored and/or frustrated, so I am going to do something stupidly different".
The seemingly fixed by algorithm human standard behavior will ultimately, eventually, lead to irrational behavior, by not fully able of "matching" actions with objective really.
Just like a trying to use knife (the human algorithm), as a hammer (the objective reality would be the nail).
https://www.amazon.com/Vehicles-Experiments-Psychology-Valen...