Cognitive bias cheat sheet
betterhumans.coach.me
betterhumans.coach.me
I wonder, are there different groups of HN readers with different attitudes towards psychology? Or does the treatment also depend on the presentation, e.g. in the form of a scientific publication vs. a brain hacking tips or cheatsheet.
It is somewhat ironic, to me, that I am basically accusing us of having an anti-intellectual bend. However, it is not unique to psychology. There is a similar slant against "academic" computer science.
Hackers often seem to have an anti authority preference and are more likely to respect the plucky diy-er than the member of the establishment that has paid their dues. Other fields are by default assumed to be obfuscationary rather than hard or deep.
Funny, the other day there was a thread about Cialdini and his books (including Influence). He has a chapter on this phenomenon (I think he called it Social Proof).
We are more receptive to ideas if it comes from "one of us".
As someone who went to college for CompSci, I see good reason for a slant against computer science. The problem is that it's the wrong topic for somebody who does software development!
What we do is not science, it's engineering. Much of the time spent teaching us the science aspect is wasted, at least compared to the opportunity to use the time on engineering topics like modeling and design, documentation, etc.
What I'm finding it difficult to find, these days, is actual mature-age accredited uni courses in computer science. Instead, you get a plethora of development courses which, as you say, are akin to engineering, not science.
The difference was somewhat ironically that the CS degree had more practical, hands on coding, and engineering was more theoretical, plus we had to take all the physics/chemistry/math courses to meet the requirements of the Engineering board.
You could argue that for many of us it is Software Carpentry.
I am a B.Sc. in something something computers. I have worked on some serious stuff (real distributed sensor systems across huge geographical areas and another time working on fringes of a soft-realtime image-recognition system).
Much of the time however I feel I'm much more of a software carpenter.
I actually quite enjoyed some of the stuff from "Software carpentry" online course even though I already was an engineer.
For somebody building the next CRUD app, perhaps. In my line of work (EDA software), I routinely apply concepts from my computation science education on the job and in my code. Algorithms, data structures, discrete mathematics, graph theory, set theory, type theory, universal algebra, tractability theory, automata theory — these are all topics where knowledge has come in handy in my professional experience at various jobs.
Of course, concepts from other fields — biology, linguistics, and physics, for example — have also come in handy on occasion. I almost feel like there's no such thing as a "wrong topic for somebody who does software development", though some topics are certainly more relevant/useful than others.
Be honest and think of all the time you've spent fiddling with build systems, various random tools (compilers, scripts, databases, version control, etc.).
Sounds exactly like what I would expect an Engineer to do. Apply theory to the real world. Versus a scientist who I would expect to develop, test, and prove new theories.
Psychology, with view to its practical (non-research) use has not helped me, but at least three people I know say they benefitted from cognitive behavioural therapy. Perhaps in the future, medicine and science will subordinate it to the same role of philosophy to better explain human behaviour and thinking as the latter did in less techical approaches for centuries. [2]
And yes, I am somewhat skeptical of said blog posts that cite some "new study" claiming to explain something only to be refuted or contradicted months later.
[1] http://www.nature.com/news/1-500-scientists-lift-the-lid-on-...
[2] Wittgenstein conceded that philosophy in the 20th century would only be useful in itsapproaches to linguistics and language
http://slatestarcodex.com/2015/09/05/if-you-cant-make-predic...
The article doesn't get into this.
Coming from a physics background, I will not say there's a crisis, but:
1. Few research is replicated.
2. We who did physics research were very unconcerned about whether our results could be replicated. Our journal papers were very concise, and it was common practice not to give all the details needed to replicate, partially due to paper size concerns, but very often also to keep the "secret recipe" to ourselves as a means to prevent others from conducting future research that we want to conduct (need less competition for grant money).
3. Pick any researcher in any field of physics, and ask them: "Can you list a few papers published in the last 15 years that are highly cited that you think are completely wrong?" Everyone will have a list like that. Everyone.
You and/or your publishers are terrible human beings.
Eh? Not sure why. Because we have a list of papers we don't believe? It would be naive to believe everything that is published.
I don't like the notion of withholding information, and personally I would not like to accept any paper that does that, but I'm merely stating the norm in the field.
You still have to contend with journal size restrictions. A paper in Physical Review Letters needs to be less than 3 pages. You simply cannot put in enough detail for replication in there. Nature has a page limit of 5.
1. propagating falsehoods, or flaws in published work without correcting or refuting their validity, claims etc. by your strong admission that everyone knows of such work (which is subsequently used and cited) yet "completely wrong" there must be so much crap getting published. but there is disinclination to do anything about it
2. witholding of information necessary for reproducing results of experiments as a means of discouraging co-operation with peers you view as rivals or adversaries.
The second is really serious because it effectively subverts the scientific method, undermining scientific consensus and progress. That these are "norms in the field" means nothing save for everybody's indifference and lack of cooperation.
Is the above correct?
To paraphrase what John Locke said to Newton: "Sir, it is the lesser duty of mine as Philosopher and under labourer of the Natural Philsopher, to remove the debris and furnish detail that the latter imparts to our Knowledge."
It should be heartening that most science topics here are treated with this kind of Feynmanian attitude, always willing to accept contradictory evidence, always reluctant to draw strong conclusions.
Incidentally, I noticed these cognitive biases probably apply equally well to strong AI (artificial intelligence). No matter how powerful an AI is, it's always going to lack some information, it will take time to calculate things, it will lack experience, and it will not have enough memory capacity to remember every detail. Strong AI will probably have to learn to use cognitive biases.
Huh? The article is entirely opinion. Every single thing that's in bold text is a testable hypothesis presented as pure fact. Even the selection of "problems" is pure and problematic conjecture (are these actually the most important problems? Are these actually problems at all? Would addressing these problems improve our decision making?).
There'll be no debate about research methods because there's no scientific research here. What's presented in this article might be based on observation, but it's definitely not based on scientific testing (or, to the extent it is, that evidence isn't presented).
There's nothing wrong with an article like this, per se. But shrugging off psychology research (much of which explores and attempts to rigorously test the conjectures made in this article), while also accepting this article's statements at face value, is a bit ridiculous. It amounts to "philosophy I agree with is not problematic, but science I agree with should be harshly critiqued"
For example, US space research at NASA may be awash in politics, crippled by a lack of long-term vision, and overly focused on military applications, but space is still cool.
The workings of the mind and the results of cognitive biases are fascinating, but that doesn't excuse poor statistics and a lack of rigor.
Yes and no. Yes, we are all different people. No, there is not much sense to grouping us based on a single dimension. That is an excellent example of what Vonnegut called a granfalloon.
yes
Yes. This isn't a monolithic hive mind or fundamentalist religion. There are people from all walks of life with different ideas here. You will find trends, but no unanimity.
Generally, it is not necessary to understand every single type of cognitive bias in a nuanced way to mitigate the problems. Indeed, sometimes cognitive biases overlap to the extent that trying to mitigate one, you'll wind up affected by another. What's important is that your behavior and social rules be oriented towards uncovering truth through dialectic methods.
Jonathan Haidt, a moral psychologist, recently posted a terrific video on the the issue viewpoint diversity on college campuses-- specifically, the lack of it. Problems of confirmation bias are exaggerated, especially in social sciences, when there's a lack of viewpoint diversity on campus. When everyone likes the conclusions put forth by a paper, no one is motivated to find the flaws. Thus the flaws are not found, the flawed papers get cited by other papers, and you wind up with a knowledge base that is increasingly divorced from reality. Whether you know the name for that bias or not is less relevant than actually addressing the structural problems.
Telos, incidentally, I consider to be a very fascinating and important concept, though only tangentially relevant to this thread.
Many biases cannot be overcome even with knowing about them... but accepting that it's possible I'm wrong and that the crazy guy on the other side is both sincere in his competing belief and possibly correct, allows me to evolve and learn and ultimately get along with more people.
I have some strongly held beliefs and opinions...But I try to keep my mind open and without considering cognitive biases, you are going to be more close minded than you should be in most cases.
As often as not you're both right but simply have different or conflicting priorities
Ideally. But keep in mind: not for everyone, and it would be in the interests of those primarily concerned with power and manipulation to convince those concerned with truth and the greater good that this is the case.
Interestingly, he won his nobel prize in the field of economics, but he's a psychologist, not an economist. His research was so influential that it changed business strategies (esp. around how meetings are held) forever.
I can't say enough good things about Thinking Fast and Slow. Go read it.
I posted this article in reply to another comment in this thread, but I think many will find it interesting and useful. It's a good jumping off point into his research and why it's important.
http://www.newyorker.com/tech/frontal-cortex/why-smart-peopl...
"The principle of independent judgments (and decorrelated errors) has immediate applications for the conduct of meetings, an activity in which executives in organizations spend a great deal of their working days. A simple rule can help: before an issue is discussed, all members of the committee should be asked to write a very brief summary of their position. This procedure makes good use of the value of the diversity of knowledge and opinion in the group. The standard practice of open discussion gives too much weight to the opinions of those who speak early and assertively, causing others to line up behind them."
(Following this advice is rare; I think it's bold to say that Kahneman's research has already changed meetings.)
As someone who just finished reading his book, I must ask for clarification. Is he talking about lack of diversity in the student body, or in the faculty body?
I know he has published work showing a bias against conservatives in his field...
He did point to statistics showing that liberal bias has been present in universities for quite some time, but that until 1990 it seemed to remain at a steady 4:1 ratio or so. But that in the last 25 years, that ratio has become much more skewed. Up to 67:1 in some fields.
So wonderfully said. I wonder what biases AI will develop in its models
Logic is simply a way to systematically eliminate these errors in wetware (and ultimately hardware).
That means that we are only capturing a "tiny sliver" of whats actually happening around us.
If we only keep this small detail in mind we can be sure that lack of evidence is never proof of anything and that any evidence we do see can only be used to find the most probable of competing hypotheses and its diagnosticity should always be considered. (i.e. fever might mean you are sick but has no diagnostic value to what particular ailment you have since its consistent with other possibilities.)
Same goes for using bounce rate as a metric for web analysis...its diagnostic value on its own doesnt tell us much, but with other context, like time on site and conversion goal of site (i.e. a phone call conversion will register as a bounce if they dont navihate elsewhere.) It can tell us a lot.
When my son was born, I spent most of the wee hours testing which Star Wars theme I hummed worked best for getting him back to sleep.
(By the way, The Imperial March worked best, especially slowed down and rocking him on every 4th beat)
http://marginalrevolution.com/marginalrevolution/2012/11/a-b...
And another view:
http://noahpinionblog.blogspot.fi/2013/05/bets-do-not-necess...
People telling someone else to 'put their money where their mouth is' are essentially asking the someone else to prove the sincerity of their belief - or the person saying it has an opposing sincere belief and they would like to make some money off of a bet over who is right.
And once you know you are wrong, you can now start figuring out what you did wrong.
And I love it!
Information is used both to understand and to influence. It's a three-edged sword.
https://cdn-images-1.medium.com/max/2000/1*71TzKnr7bzXU_l_pU...
I'm working with a largish ontology of my own I'd like to present to 2-3 and possibly more levels of depth. GraphViz isn't cutting it.
(I'd asked Manoogian himself, he vaguely pointed at some R graphics tools, which was as far as I've gotten.)
Lab results confirming cognitive biases come from testing small groups of students (up to 200). Among other things, it means: (1) respondents with similar background, so we can't generalize (2) respondents don't care about outcomes, (3) tests are synthetic. Plus publication bias and other standard issues.
These results are themselves a sort of confirmation bias.
Mistakes in real life happen when we don't know what we're doing. If a person can learn, he'll discover systematic mistakes. But that comes with domain experience, not cognitive science.
Here's a good jumping off point: http://www.newyorker.com/tech/frontal-cortex/why-smart-peopl...
I highly recommend reading more of Daniel Kahneman's work if you find the above interesting.
Resource-constrained
(Are we counting hyphens as one word or two?? :) )
Describing and categorizing systematic mistakes that people do is precisely what cognitive science does. The human mind is a domain of it's own.
I don't think there's anything the article author mentioned that argues against improvement through experience, critical thinking, and sensitivity to the limitations of the human mind.
[0] actually links to https://en.wikipedia.org/wiki/List_of_cognitive_biases
And if each quartile of the codex had a color coded mouse target, you could popup a menu of just that cluster of biases sorted into whatever spectrum makes the most sense.
A little ah-hah moment for me. :)
A good thing to think about how biased your brain is, is to think of that time when you were witnessing that wonderful sunset and you decided to take a photo. Later you look at the photo and it doesn't look at all like you remember. Why? Because it's your brain playing tricks on you. You have a built in image filter in your brain that adjusts the image and your memory of it whereas the camera sees it "objectively."
Once you become aware of all the cognitive biases you just get tired of listening to people talk (about anything really), when it's full of logical holes and anecdotes. In fact it becomes painful especially when listening to some electoral candidate / politician talk about stuff that might actually matter. sigh
I found this section was written very pourly. /s ;]
I'd be interested to know which cognitive bias is at work when the instance of the post today gets 480+ points -- but no instances of this post (same title, same url) in the past 1 month garnered more than 26 pts.
I am both new to HN, and legitimately curious. Perhaps the content of the site was improved dramatically?
edit: clarity.
[0] https://hn.algolia.com/?query=cognitive%20bias%20cheat%20she...
unless they correctly identify your hanging of the image (and implied expertise therefrom) as a fallacious appeal to internet-blog-authority!
For example, trotting out cognitive biases in a rhetorical situation is often very effective, particularly when your opponent is operating in a dialectic mindset.
Know thyself, but also know thy situation.
Is that the new standard?
PDF transcription here http://www.rbcpa.com/mungerspeech_june_95.pdf
Explains a lot (he says, during Presidential Election season in the US)
https://www.amazon.com/How-Fail-Almost-Everything-Still-eboo...
The one thing to take away from this election is that persuasion trumps everything else. It's scary and crazy!
I followed his arguments in the primaries and found them somewhat compelling, the idea that Trump was in better shape than people thought. But he's lately gone of the rails totally and completely.
And more to the point of this post, he completely misuses the phrase cognitive dissonance, having apparently defined it to mean something like "a way to tell people who disagree with me they don't know what they're talking about" rather than an actual psychological characteristic.
So many in fact, I just look at the list overwhelmed and curl in bed and suck my thumb
I like to refer to it as "short-cut thinking" rather than cognitive bias, because people that might not know the term immediately understand what I'm getting at.
Looked for myself, but i cant find anything.
I feel that someone who just uses instinct, will make faster and better decision, even with all the biases and cognitive illusions.
If you see a spider, your instinct is to kill it, it's not necessarily the better solution.
It's all about filling your brain with the latest instant fad. People get bored if they don't get their fix of fake news or cat pictures. How would they even spend a few hours doing real research and actually trying to think?
Way too hard. The internet only exacerbates these issues. This blog is even a prime example. It's telling you what to think so you don't have to, and it matches the popular bias so its easy to just praise it and move on to the next insta-fad.