If Then: How the Simulmatics Corporation Invented the Future
npr.org
npr.org
And a couple subsequent letters from readers on the article:
https://www.newyorker.com/magazine/2020/09/07/letters-from-t...
The New Yorker article was odd to me for a New Yorker article, it had a lot of historical context without a lot of details of what Simulmatics actually did for the Kennedy campaign. Perhaps there isn't a lot of historical record/people who want to talk about it. I was left feeing like I had learned that the Simulmatics founders had an idea, and successfully sold it to the Kennedy campaign and made some money, but not sure to what extent it actually provided value in that actual campaign.
With some people suggesting the same might be true of Cambridge Analytica.... the more things change? (I have no opinion on what value either CA or Simulmatics actually provided, I don't know enough).
I haven't listened to/read the NPR piece yet.
But I guess her recent book is one reason why all these media outlets are covering the same historical topic right now!
Thought the NPR article was well enough to share, but preferred the MIT piece (albeit behind a paywall)
I enjoyed the following episodes. I have not listed to the entire season, so the list below is not comprehensive.
https://www.thelastarchive.com/season-1/episode-5-project-x
https://www.thelastarchive.com/season-1/episode-7-the-comput...
https://www.thelastarchive.com/season-1/episode-10-tomorrowl...
I've changed the title to be that of the book under review. Actually we've started doing that for most book review posts (e.g. https://news.ycombinator.com/item?id=24474073). It seems to make for better discussion.
Yes the methods of data collection were slightly different between Obama's campaign and what Cambridge Analytica did and sold to conservative candidates. Obama's campaign claimed they didn't do as much with the data and it was within the FB ToS, but these claims don't change the ethics and since 2004 both parties have been building their data infrastructure out to sway voters (https://slate.com/news-and-politics/2012/10/obamas-secret-we...).
Both parties are nefarious in their use of data and attempt to persuade voters through micro-targeted outrage, and it makes me wary of ever voting for either of the two parties' candidate.
i.e. if you are campaigning for Governor of NY, you can target New York state, but you can't target Manhattan, or Long Island, or men over 50, or people who liked the NRA.
Nearly everything else will generally only reach a subset of the voters, and that subset will have known demographic differences from the overall voter demographics for the jurisdiction.
Run an ad at in the 8-8:30 PM Sunday slot on every FOX TV station in a state, for example, and you'll get quite a different demographic than if you ran an ad on those same stations on Sunday afternoon. The first ad would be during "The Simpsons" and the second would probably be during an NFL football game.
I think things like hard cap campaign contribution limits (as in overall campaign fundraising cap rather than by donor type) could do more good to even the playing field. And it should reduce the web of "IOUs" that elected officials come into office with.
It is interesting to think of campaign efficiency (or propaganda efficiency lol) as CPV (cost per vote) to make it parallel to advertising metrics like CPC and CPI.
Which was harvest private data (including messages and news feed) from Facebook users and their friends via an app that was ostensibly non-political, and then in turn sell it to a super PAC that for microtargeting. I'll note that the super PAC involved was likely coordinating with a campaign in violation of FEC campaign finance laws.
The CA scandal resulted in a $5 billion fine to Facebook by the FTC.
I think it's disingenuous to say what the Obama campaign and Trump/Cambridge did were close to the same.
Cambridge Analytica were accused of taking data mainly on what pages users 'Liked' - not private messages or news feed. (Unless you have a source?)
Obama campaign boasted about having access to the entire friends network. In other words, they know who each person was and what the connections between them were. Facebook openly said that they helped the Obama campaign get and utilise 100% of the friends network data on Facebook.
Simple scraping would get you a lot of the same data back then but it would be more involved and less solid legally. CA just figured out an easy way to do a huge scrape of Facebook.
I'd be surprised if many other organizations out there aren't sitting on similar datasets.
Even without asking any psychometric questions you could easily seed this through the dataset based on just a few examples or ground truths. This part seems rather unspectacular. With all the likes you can already tell who's alike. You just need to label the clusters.
CA's sell was this data would allow them to target super precisely and send different messages to different groups. But there's a big bottleneck at message creation. If you have 10 ads you can only target 10 groups uniquely. I'd be much more impressed if CA actually had software to manage ad creation, placement and performance tracking.
But if you actually want a refresher, and for anyone else,
Usually, even the generally available facts are a lot better than most people's understandings of the situation. For example, most people seem to think that this scandal proved that Facebook sell their user data, whereas it actually is alleged that CA took advantage of the well-documented public API that Facebook used to have, where any app vendor could download data on friends of friends who had given permissions to the app.
If you have specific questions, I would be happy to point you in the right direction.
EDIT: This was a few spots down in the search results and explains how Obama's data collection was different than CA.
https://washingtonmonthly.com/2018/03/21/no-obama-didnt-empl...
The issue was never that CA did this with "false pretences" (they didn't sign up users directly, that was done by an academic who then sold the data) or that by signing users up on your own website, you were doing some above board. The issue was that Facebook allowed access to not only your account but your friend network. That was what Obama used, that is what CA used, that is why both tried to get the Facebook login, and, btw, the end goal was exactly the same: microtargeting of ads.
Btw, there are probably hundreds of other companies who are doing the same thing. A lot of the "data science" startups are using this data in their products, there was an Israeli startup (mentioned here recently) that somehow had click data from Google, individual search data from Google...this isn't just politics, this personalised, identifying data that is somehow everywhere.
Is anyone in jail?
Are there any pending legal cases against them?
There have been multiple fines related to this scandal from multiple governments. There have been Congressional hearings on it in the US. There have been numerous lawsuits. I did say "potentially" in that first comment because I can't say definitively that they acted illegally, but there is a lot of smoke here. If people are going to make the accusation that it is a double standard, where is the smoke surrounding Obama's use of data?
I can claim that your comment is "potentially illegal" ..means nothing.
> There have been Congressional hearings on it in the US. There have been numerous lawsuits.
doesn't mean its illegal. Its just politics to discredit opposition's election victory.
This is equivalent to "hillary's emails" which also had lawsuits and congressional hearings. Now no one cares about it. Same with CA, no one will hear about it once democrats win.
> where is the smoke surrounding Obama's use of data?
There isn't because republicans didn't think it would be politically useful like "hillary's emails".
Sounds like a dog whistle
https://news.ycombinator.com/item?id=22466733
Cambridge Analytica were the tip of the iceberg (graphcommons.com)
So what are we talking about here?
And the entire thing is even more ridiculous in the larger context of how incompetent and disorganized the Trump 2016 campaign was.
Meanwhile, one aspect of the 2016 presidential coverage that drives me nuts is the omission that HRC's voter file was stolen and likely used by GOP, Trump, Russia.
Meaning they knew exactly who to target.
A campaign's voter file is it's Crown Jewels, it's secret sauce. It is the campaign.
HRC knew they had a problem in MN, WI, PA. They just couldn't figure out what was going on in time. Plus a zillion other things going on.
Again, will read your link soonest. It might help me fill in a few more of the puzzle pieces.
Yeah, the problem is that they took those states (and it’s MI not MN) for granted as safe blue states (which they had been for decades) and bought into the “Hillary is so far ahead in the polls she doesn’t even think about Trump anymore”[0] hype that they didn’t see the need to campaign there.
0: https://www.telegraph.co.uk/news/2016/10/23/hillary-clinton-...
One unintuitive thing I wish was more easily explained:
Any given move to gain votes will lose other votes. It's a wicked hard optimization problem.
I worked on election integrity stuff for about a decade. Opposing the touchscreens, tabulators, and other blackboxes. Advocating for better administration. That kind of stuff.
Like with all learning, my understanding of the problem dramatically changed over time.
The biggest threat to election integrity is change. With great reluctance I came to the view that any future changes had to be slow-rolled, even the phase out of the touchscreens. Think of it as how first responders stabilize the patient before transporting that patient.
The second biggest threat is noise. It's the asymmetry of bullshit principle. It's just so fucking hard to figure out what's going on. We spend all our time chasing wild gooses. So much slips past our attentions.
Only then can I think of the actually machinery of democracy. Stuff like form of elections, procedures, transparency, etc.
This frame and my own campaign work (stumping, GOTV, etc) informs how I regard CA and others.
The biggest threat CA poses is Steve Bannon's "flood the zone" with bullshit strategy. With so much activity below the radar, it's impossible to talk rationally about this stuff. Because there's always more to the story. Which is the trap, the exact purpose of Bannon's strategy.
The skeptics say CA, social media, etc. didn't effect voter behavior, specifically costing HRC the election.
That's entirely besides the point.
Other factors absolutely moved voters. We could stack rank them. Comey's betrayal is probably the biggest. My two personal faves are HRC's reliance on negative partisanship (too many attack ads), and HRC's desperate need to tangle with corporate media (instead of just creating HillaryTV and speaking directly to voters like Trump did with Twitter).
But there are many fights in the margins that most commentators completely ignore or outright dismiss. What we election integrity people called "death by a thousand cuts." It's never just one thing that makes the difference. That's too obvious and will eventually be corrected. Rather it's the cumulative damage of 1,000s of small attacks. Asymmetric war fare.
By keeping the contest "close", it becomes possible for the jitter (noise) to make the difference, depending on timing of the snapshot (when you measure).
And now we get to what CA and others did. Buried in all the noise, they used HRC's stolen voter file to precisely target and overwhelm "undecided" and low motivation voters. Maybe 500,000 voters in total. Tiny percentage of the electorate.
And Trump got lucky. It was just barely enough. Smaller in impact than say Jill Stein's spoiler. But on top of every thing else, it made the difference.
("Undecided" in quotes, because that's another topic onto itself.)
There is certainly no way to know to what extent CA content changed voter patterns and actions. I don’t understand how you could be so confident you are right.
This is partly true, however, a lot of hysteria around it is based off taking CA's marketing copy at face value.
The Cruz campaign (IIRC) fired them because they were useless.
Also, campaigns don't have to buy or amass that data anymore. Facebook is the largest purchaser of consumer data. So now if you use Facebook for campaign ads you get all that "for free".
Lastly, wait until you find out what the NSA knows about you. Surely that data would never be used for nefarious purposes...