Thinking About Thinking (1999)
cia.gov
cia.gov
https://web.archive.org/web/20180925191008/https://www.cia.g...
I would think the key is the latter. That is, even if you get more data it does not become __useful__ information unless you're willing and able to process it.
That aside, it's difficult, if not impossible for us "on the outside" to judge the value of these concept to the IC as we only get to know what the IC wants us to know. They're playing the long game. They're playing chess. Maybe it's just me but when I hear a news story (or a friend / colleague) that says "The NSA said..." or the "CIA said..." I accept those as close to meaningless. The IC is, afterall, in the misinformation business.
p.s. I believe the proper term for tbinking about thinking is meta-cognition. I find it odd that the CIA would avoid using the proper term.
A large part of "intelligence analysis" is just using domain-specific knowledge to take primary sources and translate/summarize them, such that you remove the need for others to have domain-specific knowledge in understanding that data.
As such, if you're pedantically using ten-dollar words just because they're "correct", you're not doing your job as an analyst.
High-level IA is about other things, but that doesn't mean you unlearn the skills you have ground into you as a desk worker.
That being said, if this book is afraid to venture outside its safe zone (and mention meta-congition, even in a passing reference) then this book, by defintion, has failed to do what IC analysis is supposed to do. Ironic, huh.
I think it's ssafe to say history is on the side of my analysis of this analysis ;)
The articles are based on reviewing cognitive psychology literature concerning how people process information to make judgments on incomplete and ambiguous information. I selected the experiments and findings that seem most relevant to intelligence analysis and most in need of communication to intelligence analysts. I then translated the technical reports into language that intelligence analysts can understand and interpreted the relevance of these findings to the problems intelligence analysts face.
The result is a compromise that may not be wholly satisfactory to either research psychologists or intelligence analysts. Cognitive psychologists and decision analysts may complain of oversimplification [...]
You’ve provided no examples to support this conclusion.
If you believe there was Russian election hacking, start there and work your way back. A highlight going back would be the CIA training of UBL. The IC was instrumental in escalating the Vietnam War. Etc.
If the IC's job is to think about thining the unthinkable, they have in fact come up short in a big way often enough. I sincerely didn't think stating the obvious was kosher on HN. Sorry.
So back to metacognition. This is clearly phrased in a way everybody can understand as 'thinking about thinking.' The latter is, at worst, slightly more verbose. By contrast let's consider another fairly esoteric term such as 'cognitive dissonance.' There is really no way effectively communicate and convey the idea of cognitive dissonance, with all its nuance, in a comparably brief phrase so it makes sense to use the word. But metacognition? It's really just taking a simple concept and replacing it with a fancy sounding word.
I don't know why we do this in so many fields. It just creates artificial barriers to communication and clear conveyance of ideas.
More important is communication to your audience, and in that respect "meta-cognition" is pretty awful vocabulary that strongly limits your audience in this case.
We actually use this as a strategy in my project. When talking to sponsors, funders, etc, we use very plain language: "We are going to X to Y all Z". In the real version, the average number of syllables is less than 1.5 and the longest word has 3 syllables.
But the claim is pretty outrageous so they also want to know the money is going to serious effort. To verify that, they want external validation, so we have to publish peer-reviewed papers. Those papers are loaded with jargon from multiple fields and we intentionally emphasize the lowest possible performance metrics so almost no one is really going to understand how insanely good the results are, and how impactful they are to the domain in question.
Put another way, if you're in the IC or getting info from the IC and the use of the word / concept meta-cognition scares you then something is very very wrong.
The audience here isn't TMZ viewers. Is it?
And please see my comment up a level but still below my original comment. Long to story, the IC, by definition, shouldn't be afraid to use the word meta-cognition; it ultimately exposes its analysts to another area of study that could / would broaden then. The irony being, this is what this book is championing.
If the IC is too good for dog fooding then we're all in big trouble.
Not Thinking About Thinking?
IDK. Given the intended audience, as well as the general process / mindset he's championing I don't ssee how meta-cognition is a tough word. I mean, if you don't know it doesn't that literally force you to reconsider your thinking.
Meta-cognition - given the source, the target audience, the subject matter and the context is hardly a fancy word.
Now, "cognition" is an easy enough word to define to an acceptable approximation (namely by giving the synonym "thinking").
However, "meta" is a concept less frequently encountered (or at least, explicitly described) in everyday life, and would probably require a few examples to convey. Part of the issue is that you are defining the general concept of "X relating to X" in order to describe the specific case of "Thinking relating to thinking".
If your listener already has the concept "meta", then, yes, this is fine, but if they don't then you are like the mathematician attempting to define the most abstract version of a problem to the physicist who only wants to solve a single, specific case.
Yes. Of course there are. But if those people exist within the target market for the material then challenging them to look beyond their own (thinking) bounds is __exactly__ what he's prescribing, yes?
And not challenging / the status quo is exact opposite.
Meta-cognition: Thinking About Thinking
would have been appropriate. Certainly better than:
Thinking About Thinking (But Don't Think Too Much)
as seems to be implied by some.
"In a game of chess, you must never let your opponent see your pieces", as renowned military strategist Z. Brannigan said.
https://www.cia.gov/library/center-for-the-study-of-intellig...
I'm no longer fully convinced that language and metaphor generates consciousness though.
It might just be a subset of what generates consciousness.
This CIA training book is all about avoiding self-deception and getting as close as possible to the truth. Those are good aspirations for any trade. Try debugging a complex system without doing those things. You can't.
But there's a whole lot more to making the truth useful. People with power must also avoid self-deception: they must listen. That didn't happen back in 2002-2003.
The movie is about Bush 43 and Cheney's push to convince the world about nuclear weapons in Iraq. That administration infamously disclosed the identity of a CIA undercover person called Valerie Plame. They did so to discredit her spouse Ambassador Joe Wilson.
Mr. Wilson made a fact-finding trip to the nation of Niger (north of Nigeria) to verify the administration's claim that Niger's uranium mines sold vast quantities of yellowcake uranium oxide to Iraq. Mr. Wilson's investigation proved that claim was false. Therefore, he needed to be discredited. Therefore the White House outed his spouse, wrecking her career and losing the lives of her contacts in various places.
CIA people come off as the good guys--earnest purveyors of truth--both in the movie and this training book. But even they can't prevent the kind of collective self-delusion that comes when politicians' minds are made up.
How many of us hackers embark on projects we know are doomed to failure? How many of us know how to validate our hunches with the right amount of information? Many of us, because that's the easy part. How many of us know how to convince people above us in the food chain? Far fewer. That's a place where training might come in handy.
This must be the standard to be taken seriously. Anybody can wax on about how to avoid systemic biases, but it's my understanding that the research shows studying biases doesn't remove them.
Is there any alternative theory or method about how to avoid systematic bias other than being aware of systematic bias?
Also comment, I think the studies of awareness bias involved very simple phenomena. That may or may not carry-over to more complex processes.
Don't see why implicit biases should be any harder to combat than any other bias you see in a scientific field, and scientists all have to learn and work hard to combat them to avoid results that don't hold up to scrutiny. I assume engineers are similar, you probably have bad habits coming in or poor intuition about how things should fit together. By example and practice you train your intuition to align with reality.
EX1: If you only add people to your team that pass your interview process you never test if it’s actually effective.
If you replace that with say a score card to rate people on various metrics then compare actual preformace with your metrics then you have some feedback to improve the system.
EX2: For a one time event like a music / art / writing contest. Remove the bias inducing elements by just judging the output.
I don’t think they do. We really have very limited control over it. But I think that, just like you can become a professional athlete in just one sport (as opposed to many sports), you could also become very good at avoiding a specific type of bias.
practicing actually avoiding it..
one can be aware but still not listen to the 'voice of objectivity' -
personal preferences very often override morals/ethics/etc, and we are very good at rationalizing.
Looks like evolutionary psychology with a dash of environmental psychology.
Interesting quote from the abstract:
“Intelligence is naturally defined as behavior that increases the likelihood of reproductive success, and bounds on rationality are determined by physiological and environmental constraints.”
[1] https://en.wikipedia.org/wiki/Richards_Heuer
[2] https://en.wikipedia.org/wiki/United_States_involvement_in_r...
The fact is that the CIA in that period was absolutely inept. It failed to build any significant intelligence networks in either the Soviet Union or China, mispredicted critical events such as China's entrance into the Korean War, and squandered thousands of lives by attempting to parachute them into Eastern Europe, China, or North Korea to meet up with fictitious resistance forces. The CIA itself and its intelligence sources were routinely comprised by the Soviets and fed false information to the President.
The two "successful" operations of the era (Iran and Guatemala) replaced democratically elected leaders with brutal authoritarian regimes, and both of them barely succeeded though an embarrassing comedy of errors.
> I don't know if that makes him a trustworthy authority on intelligence analysis.
...only really applies if there is someone who is a "trustworthy authority on intelligence analysis."
If everyone is just flailing around, then we may as well listen to the experiences of a person who's been flailing around for the longest time. At least they've made a lot of mistakes you can learn from.
Western intel agencies were like children playing against professionals.
Another example is Mossad orders go magnitude better. Can you imagine Americans, British or hell anyone really pulling off Spring of Youth? Consider the depth of intel needed to pull something like that off. Obviously the Yom Kippur war will be mentioned.. thing was warning were passed to Golda Meir.. Israel should have mobilized and struck first but political decision was made it was not really fault of intel.
Georgi Agabekov, uncovered 400 KGB agents in Iran.
Vladimir Petrov, uncovered 600 KGB agents, including Kim Philby.
Gordievsky, head of KGB residenture in London, exposed all of it.
The failure of Berlin Tunnel.
Polyakov, head of GRU China sector. Exposed 1650 Soviet and 19 foreign GRU agents and operatives.
Penkovsky, provided 7500 pages of documentation on Soviet missile designs and rocket fuel types to CIA.
I think that’s mostly because the CIA is focusing on analyzing what I believe is mostly meaningless information about its “adversaries” instead of doing their best to try and get the best information there is, even from the horse’s mouth, so to speak.
More to the point, I’m thinking about medieval Venice which I see as the “master of them all” when it comes to collecting meaningful intelligence. When they wanted to know if some other medieval entity was about to enter war against the Turks or not (the Turks had become their greatest foe) they were actually sending some Venice merchant (or at least that was his official guise) to actually live at the ruler’s court of that medieval entity and hear directly from that ruler’s mouth what his intentions were. Venice even had people in Istanbul itself which were often seen at the Sultan’s or the Grand Vizier’s court in order to try and understand what the Turks’ intentions were. Back to the CIA and China, they should have had their men at Mao’s “court” if they really had wanted to know his intentions. They didn’t because they probably couldn’t so that they tried instead to guess his intentions by over-analyzing what Mao and his people decided to publish through Chinese propaganda channels.
Not even close to true. There are still Tibetan, Cuban, Southeast Asian, and South American ops that are still highly classified. A considerable number of nuclear-related operations are also unknown to the public.
As far as “Democratically elected leaders,” that is subject to debate given the breadth and depth of Soviet operations at the time, especially Department A of the First Chief Directorate. Even the Palestinian “situation” was primarily created with Soviet sponsorship to destabilize America’s chief ally in the region.
The history of CIA goes far beyond the sophomoric understanding of many of its detractors. Definitely not angels, but it’s a far more nuanced history, much of it untold.
That one may have been MacArthur's misunderstanding rather than the CIA.
So the CIA is about as good as mainstream economists, then?
The West has created a power vacuum that has allowed these entities to impose their control.
Hey what a coincidence: https://en.wikipedia.org/wiki/Church_Committee
I expect authorities in most (actively practiced) subjects to have experienced a major failure or few, let alone a subject as involved as IA can be.
Covert operations that are perfectly planned can go wrong.
Who's talking about failure?
> the analysis was correct but the execution botched
Are you willing to say this about all items on this page from 1951 - 1975? I haven't looked at it in-depth, but here's literally the first thing I scrolled onto, Bolivia 1971
> The U.S. government supported the 1971 coup led by General Hugo Banzer that toppled President Juan José Torres of Bolivia. Torres had displeased Washington by convening an "Asamblea del Pueblo" (People's Assembly or Popular Assembly), in which representatives of specific proletarian sectors of society were represented (miners, unionized teachers, students, peasants), and more generally by leading the country in what was perceived as a left wing direction. Banzer hatched a bloody military uprising starting on August 18, 1971 that succeeded in taking the reigns of power by August 22, 1971. After Banzer took power, the U.S. provided extensive military and other aid to the Banzer dictatorship as Banzer cracked down on freedom of speech and dissent, tortured thousands, "disappeared" and murdered hundreds, and closed labor unions and the universities. Torres, who had fled Bolivia, was kidnapped and assassinated in 1976 as part of Operation Condor, the US-supported campaign of political repression and state terrorism by South American right-wing dictators.
Yes, that doesn't invalidate everything he writes, of course. It just means he leaves all the stuff out that a person capable of being complicit in such things cannot be able to do, so it should absolutely be taken with a huge grain of salt, like dating advice from someone who might be a highly intelligent and charming sociopath.
"Botched execution", that's like saying a robbery was just the attempt to give a person a hug gone wrong. Yeah, maybe they didn't want to end up shooting the whole family including the children and a bunch of bystanders, maybe they "just" wanted to kill the father, knock the mother out, and run away with the purse. That's the "mistakes" they're making, it's a very vulgar euphemism in light of what it describes.
...they don't? Yes, naturally, or they wouldn't be doing that stuff. And you might disagree with my assessment, but I don't, that's why I made it.
> US supports US interests
That's a abstraction so simplified it says nothing at all.
> pro-US power, weakened region
There's a lot of murdered people included in that. Regions don't get weakened, people get killed. Euphemisms are a powerful drug.
> Don't conflate actual goals with the justifications (human rights, freedom of speech, etc) government uses to convince own population.
I simply "disagree with their goals" (like I "disagree with the goals of Adolf Hitler"), not because they lie about them. (on the topic of thinking, not having several "truths" to keep track of really helps with that)
There is a reason these things are used as justifications in the exactly the same way a scammer will talk about gain and not loss. The fact that the scammer actually intends to scam doesn't make it any better. That they don't actually WANT to do anything good makes it worse.
If the US population the US government derives its sole legitimation from knew half of what is done in their name, to serve very, very narrow interests within the US, not theirs, they would be furious.
You're conflating all of that under "US supporting US interests", and for that end, the US has to lie to itself.
Which is to say is, one part of consciousnesses can take control of another part through training, yes. But who is it that is taking control? Until we self-determine this (or accept some form of math as an arbitrator of reality where applicable) one bias or conditioning is simply replaced with another. Can't get the most accurate models like that.
https://www.cia.gov/library/center-for-the-study-of-intellig...
Feedback appreciated!
So... who is it that has (or doesn't have) free will?
It just happens that free will is the effect and not the cause, output rather than input. Buddhists were right about the self being an illusion.