Terrorist watchlist exposed via misconfigured Elasticsearch cluster
bleepingcomputer.com
bleepingcomputer.com
I’m curious how many journalists are on the list. Now that we are pulling out of Afghanistan, we should reevaluate the other actions we took after 9/11. The patriot act deserves another look and possible edit.
The no fly list is much smaller, and far less ambiguous in its impact. You’re on that, you’ll find out the first time you try and fly.
About the no-fly list specifically, you should really check out https://en.wikipedia.org/wiki/No_Fly_List#Notable_cases . Some relevant quotes:
> TSA refused to allow an Air France flight from Paris to Mexico to cross U.S. airspace because it was carrying Colombian journalist Hernando Calvo Ospina
> On August 19, 2009, Air France flight AF-438 was not allowed to cross into U.S. airspace because of the presence on board of one Paul-Emile Dupret, a civil servant at the European Parliament for 18 years, who had written some articles criticizing the EU's policies toward Latin America because they are aligned too closely with those of the United States
> A U.S. citizen, stranded in Colombia after being placed on the No Fly List as a result of having studied in Yemen
> In October 2008, the Washington Post reported that Maryland State Police classified 53 nonviolent political activists as terrorists, and entered their names and personal information into state and federal databases
Seems like it's not hard in practice for psychopaths in uniforms to abuse secretive powers given to them.
https://www.fincen.gov/sites/default/files/shared/314afactsh...
https://eff.org/deeplinks/2020/12/section-215-expired-year-r...
> "On March 15, 2020, Section 215 of the PATRIOT Act—a surveillance law with a rich history of government overreach and abuse—expired due to its sunset clause. Along with two other PATRIOT Act provisions, Section 215 lapsed after lawmakers failed to reach an agreement on a broader set of reforms to the Foreign Intelligence Surveillance Act (FISA)."
The EFF reported on the expiration in the brief window when there were no authorizations:
https://www.eff.org/deeplinks/2020/04/yes-section-215-expire...
It's being reintroduced as the equally doublespeak "USA FREEDOM Reauthorization Act":
https://www.congress.gov/bill/116th-congress/house-bill/6172
I'd be interested to know if any behavior was changed during the few weeks that the permissions were not covered by either law.
rate-limit edit:
I don't think Baader Meinhoff applies when I already know what a backcronym is and also have to extrapolate the first letter of all the words to get the joke.
Was there a show or pop culture thing that has people leaning towards this joke?
If anything, this could be a perceptive bias where I am forcing meaning into something, but a FUBAR Defense Act is exactly what that poster was going for. Who knows about the other one I saw earlier.
The patriot act did expand the bank secrecy act.
https://blockclubchicago.org/2021/07/28/police-gang-database...
https://www.tampabay.com/news/publicsafety/crime/police-gang...
https://www.avvo.com/legal-answers/i-was-put-on-the-gang-lis...
https://www.policemag.com/340392/identifying-and-documenting...
Civil courts have been able to exercise significant control of your life, including extended imprisonment without due process, for longer than these lists have been in effect. Frankly Americans have a lot fewer rights than they think they have, including the non-right of due process for being on a government list.
Edit: To pre-empt some comments I know are coming, civil courts do not require due process in the way you probably think of due process: a civil court can act against you without giving you representation, without allowing you to have representation, without you present, in secret from the public, and even without notifying you
EDIT2: While I'm soapboxing I'll note the power the civil court has over you isn't much different than the power three-letter agencies have over you (since they are usually given very broad mandates), it's just that civil courts have been around so much longer it's a good retort to people thinking they used to have rights. Whatever three-letters can't do to you is generally picked up by similar state agencies.
In any case, I was mostly thinking that it has to be a form of privilege to feel like a particular slippery slope hasn't happened yet. I think about how the word "privilege" is used, and its more like "exemption from some inconveniences that aren't obvious". Your post about people not noticing that civil courts and agencies have these power over assumed rights is a decent example of that.
While there is no right to be afforded free legal representation in civil court in most US jurisdictions (some do) and a civil court can render rulings and judgments against parties who are not represented by counsel, a civil court cannot prohibit a party from having legal representation, which is what your comment seems to suggest.
A civil court can render a ruling against a party if the party is not present, but it will typically go to great lengths to ensure that notice is given to parties before doing so (pleadings served to last address by process server, notice published, etc.). There are typically strict requirements that have to be met before civil court can render a ruling or judgment without a party present, especially where there is no indication that the party has received notice first.
A lot of anecdotes about drastic judgments and rulings being handed down by civil courts happen when parties ignore notice of the proceedings. There are a lot of rules for handling cases in civil court and they are grounded in the constitutional right to due process. Notice and due process are taken really seriously in most US jurisdictions. Federal Courts are especially strict about following the rules.
> https://www.law.cornell.edu/rules/frcp
This is a good point for federal cases, but I meant my comment to cover civil action in state courts too. These are the courts that are most likely to affect someone's life. For instance in California small claims courts you are not allowed to be represented.
Also, I believe in small claims as a defendant you can appoint an attorney to represent you. I sued a tow operator in small claims court and the dude who showed up was definitely an attorney.
That might be because you were suing a company, though. How would a company "represent itself"? Get the board of directors in?
As far as a company speaking for itself, a corporate representative is often designated to speak for and bind the company in any civil action.
See, e.g., Federal Rule 30(b)(6): https://www.law.cornell.edu/rules/frcp/rule_30
In many types of cases, but not all. Protection from abuse order hearings generally happen without the knowledge of the target of the order.
The process is commonly abused by divorce lawyers to gain control of the house for their client, and the bar for evidence is extremely low. The way our adversarial justice system is supposed to work is that the truth comes out in a fair fight. This process obviously ignores this foundation.
If there's really enough evidence to suggest immediate violence, then they should be arrested for terroristic threats and other stuff. And let's not forget that the protective order is just a piece of paper and won't stop any violence if the person is truly motivated.
Frankly, I think a lot of civil court actions have been created just to avoid the protections guaranteed in the criminal system.
I presume you're one of the fortunate majority who've never had domestic abusers injure (temporarily or permanently) or kill someone loved.
Very true
What novel 'due process' do you believe is necessary for the police to unintrusively start investigating someone?
We already require judge-issued warrants for intrusive investigations (Searching your things, tapping your phone lines, arresting you, etc).
I don't believe there's any country in the world that requires a judge to review the police putting you on a list as a person of interest. I am no legal scholar, so I should probably cut myself off right here - but do you not think that perhaps, there is a valid reason for this? You're inventing novel legal practices without precedent, here.
Edit: Because people assumed I was talking about the no-fly list specifically; I'm not. The terror watch list also winds up being used to cause problems for people.
From: THE PROGRESS AND PITFALLS OF THE TERRORIST WATCH LIST By: COMMITTEE ON HOMELAND SECURITY https://www.govinfo.gov/content/pkg/CHRG-110hhrg48979/html/C...
> Inaccurate watch list information also increases the chances of innocent persons being stopped or detained because of misidentification.
A page by the ACLU goes into some detail. https://www.aclu.org/other/us-government-watchlisting-unfair...
That list, and others, are not innocent "we're just keeping an eye on these people" lists. Their use causes serious harm.
The parent poster takes issue with the fact that an unintrusive person of interest list exists, and wants oversight on it. This is an absolutely unprecedented legal take.
It doesn't help that they are conflating the two (one of which is, at a first glance reasonable, and the other is not), when they are not the same thing. All that does is muddy the waters.
1. What do you think happens to people on it?
2. Which of those actions should require judicial oversight, but currently don't?
So far, the only answers to those questions in this thread have been 'imagine if...' tangents. I don't need to imagine strawmen, I'd like to know what is currently wrong.
Imagining disasters is how we're in this mess, I'd like to know what the actionable problem is.
I posted some links in my original comment that talk about specific problems. That being said, "allowing those in authority to do things that could be used inappropriately... and then it turning out that they did exactly that" doesn't require ANY imagination. The US government engages in such behavior on a daily basis.
None of them demand that police lists should not exist, or that judicial oversight should be necessary to put a person on one.
Instead, they demand that:
1. The lists be accurate.
2. The lists be accurate.
3. Allowing people to contest them on a case-by-case basis.
4. To not blacklist people from employment based on them.
The ACLU seems to be in agreement with me.
What if we weren't allowed to confirm or deny you were on the list, except to a prospective landlord or employer who filled out a form?
What if there were no way to find out those were the reasons I put you on the list, and no appeals process to be removed from the list?
What if you couldn't prove standing in court because there was no legal way to prove you were on the list at all without a friendly judge?
> You're inventing novel legal practices without precedent
Which is why people are forced to rely on the racial makeup of these horrifying lists in order to challenge them. The problem becomes a lot clearer if your local police force makes up a list of all Jews in the neighborhood (whatever criteria they decide to use, i.e. "valid reason") for special treatment.
edit: and, of course, what if the list leaks, and is used as an automated first step for disqualification by employers and landlords for the rest of your life?
I don't know, I wouldn't be able to tell. If a tree falls in the forest, and nobody's there to hear it, does it matter to anyone whether it makes a sound?
> What if we weren't allowed to confirm or deny you were on the list, except to a prospective landlord or employer who filled out a form?
You're swinging at strawmen. Nobody in this thread is defending intrusive lists.
For some reason, though, you are conflating unintrusive lists (Which don't require oversight anywhere in the world) with intrusive lists (Which do require oversight in... well-governed parts of the world).
Do you have arguments against the former? I'm not interested in being convinced that the latter are bad, I'm already convinced that they are bad.
> edit: and, of course, what if the list leaks, and is used as an automated first step for disqualification by employers and landlords for the rest of your life?
If there's an unholy decades-long alliance between the FBI, the background check bureaus, and millions of employers and landlords, that neither my federal, state, or municipal government is interested in doing anything about, I think my main problem is not 'the FBI has a list'. I think my main problem is 'My society, on every imaginable level, is broken.'
>I don't know, I wouldn't be able to tell. If a tree falls in the forest, and nobody's there to hear it, does it matter to anyone whether it makes a sound?
Spoken like someone who hasn't had the long arm of the law drop in on them before, or a person who "doesn't care about that liberty anyway, so why not vote it away?"
Just because you don't see the problem doesn't mean it isn't there. Just because you didn't see the tree fall, doesn't mean the world is uneffected. These are concepts 3-4 year olds manage to divest themselves of once they grap the permanence of objects. Just because you don't get much out of a liberty doesn't mean that it's cool to force the loss of it on somebody else. Liberty is to be treasured and protected. The selective relinquishment, revocation, or limiting of one for anyone should be a Big. Frigging. Deal.
The fact people are so cavalier with wisking away the freedoms that underpin American Civil Life on mere suspicion of something that the State is not even required to be transparent about should disturb everybody.
More importantly, this:
> Spoken like someone who hasn't had the long arm of the law drop in on them before, or a person who "doesn't care about that liberty anyway, so why not vote it away?"
Who are you quoting here? No one said this at all.
I'm actually disgusted by your comment and the logic you present in it.
It's a lot more straight-forward if the police investigate crimes reported to them by citizens. That's what they are supposedly there for, right?
> Of these defendants caught up in FBI terrorism sting operations, an FBI informant was the person who led one of every three terrorist plots, and the FBI also provided all of the necessary weapons, money, and transportation.
I'm sure such a thing is something no American would agree with. I wouldn't be surprised if similar actions were happening at all levels (gangs to terrorists). I'm sure this also isn't isolated to America either, as it appears to be the incentives that causes this and how we measure success (i.e. how many criminals are caught).
These conversations are extremely complex. But I think we need large social discussions about how to actually solve crime and prevent animosity in the world. I think it is time for a big rethink. If there's 2 million people on a list, I'm not sure that list is very effective. It's like looking for needles in a haystack by adding more hay.
[0] https://www.brandeis.edu/investigate/government-corporate-wr...
I'm in. Where's the convention, and how do we get our idiot representatives to play along?
Until we the people are actually represented in the legislative branch nothing fundamental will change. Being that the other branches are largely unaccountable to the citizenry, the legislative branch is the logical entity to focus on (and the fourth estate, heavily under attack by the executive et al)
While imperfect, I think that German electoral system is much better. Any party that gets 5% or more of the vote is guaranteed fair representation, gerrymandering isn't a possibility.
However, in a multiparty system deals still have to be struck to put together governing coalitions, so a party that insists on being purist is likely to be shut out.
If people are serious about voting reform (and they should be) then this "spoiler effect" can be weaponized: start a grassroots campaign to vote third party until the Democrats support changing the voting system at the state level (and vote in primaries for Democrats who support this change).
This may lead to few tight state races being lost, but that means that only a small percentage of the population would be enough to get the Democratic Party officials to take notice. To make the signal even more clear, the third party chosen should be one that focuses as narrowly as possible on voting reform, such as the Alliance Party[0], which may also encourage some disgruntled Republicans to temporarily lend their votes, whereas they would be more reluctant to support the Green Party, for example.
Of course there is a danger that voting reform would get portrayed as a pro-Democrat policy (if it isn't already), but once enough Republicans (in majority Democrat states) have experience casting their ballot in a more expressive and representative system, it will be harder for Republicans in other states to oppose it.
But yes, there are a lot of professional campaign consultants who have the system wired that they profit whether they win or lose, and many of those work for Democrats.
To be clear are we talking about the politicians or the people? The people, yes. Politicians I'm not so sure about. Also I'd encourage you to read my other comment which addresses ordinal voting (like IRV) and the issues with them. It might be why the party likes it (still having vote splitting in the primaries).
Seems like it would be a better and safer idea to to work towards the same goal using primaries to tilt already democratic districts in the direction of reformers.
I often see people compare the US system to European systems and use "party" in both. I think this results in a pretty bad comparison, but takes some nuance to understand why. Democrats and Republicans are more accurately compared to coalitions in European systems than they are to European parties. As a point, AOC or Bernie have very different political ideologies than say Pelosi or Biden, yet are in the same party. Similarly Trump is very different ideologically than say John Kasich. While there is variance within European political parties I believe that we see a larger variance within American parties and thus it makes it more accurate to compare to coalitions.
In addition to this we should recognize that most European systems are working under a parliamentary system which causes this proportionate representation. We don't quite have a system like that in America and it would be tough to change the entire system. This is why many people, such as myself, are proposing systems like STAR or Approval. By being able to score (or rate) candidates (instead of ranking) we can achieve a proportionate representation with very minimal change, especially since systems like Approval already work on current voting machines. It is also a lot easier and more transparent compared to many round systems from ordinal voting.
>(example: Republicans paying fees and collecting signatures to get Greens on the ballot to divide the left vote and get a Republican in office, though this problem could be fixed with some form of instant runoff
But I also want to be clear about this. Ordinal systems (such as IRV/STV) fix this kind of spoiler there is another spoiler that is fairly important: the favorite betrayer. That is because the green party here is called a weak spoiler, they don't have a large voter base. But we need to also be VERY concerned with strong spoilers. For example: if Bernie ran against Biden. Ordinal systems are still vulnerable to this type of spoiler while cardinal systems are resistant to both strong and weak spoilers.
Edit: I wanted to add that we actually saw strong spoilers in the 2016 and 2020 elections, in the primaries. In 2016 it happened in both parties. Bernie and Clinton were a split. Many people didn't vote Bernie because they thought Hillary would better beat Trump. Similarly in the Republican party you had Trump, Cruz, and Kasich. Many Republicans liked a moderate like Kasich but didn't think he was a strong candidate. In the 2020 election we again saw this vote splitting in the Democratic primaries. While these cases are more obvious, such splitting also happens a lot in congressional races and other down ballot races.
Could you clarify what you mean here? There is nothing about a parliamentary system which inherently requires or leads to proportional representation, as the UK system shows. Similarly it would be possible in the US congressional system to have proportional representation by having multi-member districts (as was allowed[0] before 1967) and using a system like STV, also called multi-winner ranked-choice voting.[1]
> cardinal systems are resistant to both strong and weak spoilers.
While I support any serious alternative to FPTP, it's worth being aware of the deficiencies of Approval voting. Firstly, it can confront voters with difficult questions about whether they support a certain candidate enough to approve of them. For example, a Democrat voter might hedge their bets by voting for a moderate Republican to prevent a more extreme Republican winning, while hoping that enough Republicans approve of a moderate Democrat.
Secondly, though, I think that an important goal for a voting systems is that it doesn't increase (and ideally decreases) the dependence on voting machines. As recent events have shown, every additional element to a voting system is just expanding the attack surface for people to target FUD at, and a voting machine is a complex system which is very hard for the average voter to reason about (even if the purported hardware designs and source code were publicly available).
While it is still feasible to count Approval ballots by hand, and the process can be split between districts to produce sub-totals which can be summed, the fact that a given ballot can have multiple marks on it does increase the complexity for human counters, which makes the counting slower and more expensive. In particular, if there are N candidates in an election, then a FPTP ballot can be placed onto one of N piles, whereas 2^N piles are needed to group all possible Approval votes physically together.
I don't know how much that complexity would actually slow down the counting, but in a world where election workers are being threatened with violence for doing their job, even an extra hour of counting is hard to justify. Fortunately, though, there is a voting system which satisfies the above criteria, namely Asset Voting.[2] In its single-winner variant, the election proceeds just like a FPTP one, with the same ballot papers, instructions, and counting process, but after the count is complete, the candidates from fewest to most votes get to reassign their share to a remaining candidate, until one candidate has a majority. This removes the spoiler problem, and relies on the fact that voters are choosing someone to represent them and who can therefore be entrusted with the job of assigning their votes to the ultimate winner if necessary.
[0] https://www.amacad.org/ourcommonpurpose/recommendation-1-3
[1] https://en.wikipedia.org/wiki/Single_transferable_vote
[2] https://en.wikipedia.org/wiki/Proportional_representation#As...
I'm sorry, but I find this concern a bit in bad taste. This type of strategic voting exists in every voting system. In ordinal systems (such as IRV, STV, etc) you artificially rank candidates higher than what your actual preference is. The same thing about the second concern (you add the Republican to your ranking). It's a pretty universal strategy in voting so I'm not sure why this is a problem specific to Approval, and thus why it it is being brought up. This can easily be mitigated by using score voting. In addition, I would like to point out that the benefit of STAR is that is is extremely resistant to strategies. AFAIK it is the most resistant voting system.
> As recent events have shown, every additional element to a voting system is just expanding the attack surface for people to target FUD at, and a voting machine is a complex system which is very hard for the average voter to reason about (even if the purported hardware designs and source code were publicly available).
I'm confused by this comment. I see Arizona as the prime example of why we would NOT want an ordinal system. Ordinal systems like STV and IRV have multi rounds. Let's look at the two algorithms (at an abstract level. This will be fine for STV/IRV/Approval/Score)
Ordinal:
Count tallies of all ranked candidates. If top candidate >50% declare winner else remove argmin from list and goto top.
Cardinal:
Sum scores of all rated candidates. Declare argmax as winner.
I don't know about you, but summing columns and taking argmax seems way easier to me than the multi-round system. We've seen that in many ranked elections that you have many many rounds. The NYC Mayoral race had 8 rounds FWIW. Approval is one round (like FPTP) and STAR is at most 2 rounds (it is always 2 rounds in fact). I do not know how anyone can argue that the counting of cardinal systems are more complex. You note that even an extra hour is difficult and I'll note that IRV takes days to count, as seen in NYC and others.
I should highlight, again, that the US has had STV in the past and then many of those cities went back to FPTP because it was complicated and didn't solve the issues they wanted to.
> In its single-winner variant, the election proceeds just like a FPTP one, with the same ballot papers, instructions, and counting process, but after the count is complete, the candidates from fewest to most votes get to reassign their share to a remaining candidate, until one candidate has a majority. This removes the spoiler problem
I'm not sure why you felt it was important to explain this to me when I've already demonstrated a working knowledge and at this point I also feel that you ignored a good portion of my previous post that was about strong and weak spoilers. Where I talked about how ordinal systems prevent weak spoilers but not strong spoilers. Maybe a source would help?[0] Weak spoilers aren't a concern. Strong spoilers, aka a favorite betrayer, are. Solving weak spoilers allow third parties to exist, but it doesn't allow them to win.
As for Asset voting I'm extremely against this. That's just making collusion rings easier. Again, let's look at the 2016 and 2020 elections. That's just letting the parties dictate who can run in the elections. This is a major problem in our system.
And I'm sorry that you feel this way, as I was not trying to insult Approval Voting (which, as I indicated, I would strongly support over FPTP) nor trying to detract from the positive contribution you have made to this discussion.
> The same thing about the second concern (you add the Republican to your ranking).
I think that, at least conceptually, it is easier for a voter to say "I support Hillary more than Romney" or even to give those candidates different scores out of 10, than to say "My 'approval threshold' is calibrated such that Romney is below it and Hillary is above it".
You're probably right that in (some?) ordinal systems there are counter-intuitive outcomes that can result from ranking a less preferred candidate too highly, or even from ranking them at all (if the system doesn't require an exhaustive ranking of all candidates), but the question being asked of the voter at least doesn't require them to pick a parameter for which there doesn't appear to be a "correct" value even assuming they have perfectly formed opinions of each candidate.
> the benefit of STAR is that is is extremely resistant to strategies.
I would have difficulty predicting what would happen if I under/over-voted a candidate I grudgingly accepted, so my instinct would be to vote honestly (which is probably the best outcome of a voting system given the impossibility of a strategy-free system), but my objection to STAR is that it is harder to fill in and count by hand (requiring 2^6N piles, or the use of N calculators).
> Ordinal systems like STV and IRV have multi rounds.
Agreed. From that perspective, Approval Voting is clearly preferable.
> I should highlight, again, that the US has had STV in the past and then many of those cities went back to FPTP because it was complicated and didn't solve the issues they wanted to.
I know of examples of IRV being abandoned, which I assume is what you're referring to here. (Voting system terminology probably differs around the world, but I tend to think of STV as being a multi-winner system and IRV being single-winner).
For me, the most important property of a voting system is for it to have a strong chance of being adopted, which is the only reason I support more US jurisdiction adopting IRV, but you're right that there is a potential "well-poisoning" effect where a reform gets adopted and then quickly abandoned, harming future reform efforts. This risk has to be balanced, though, against that of a less popular reform being proposed and failing to be adopted, which is likely to be portrayed as a lack of support for any reform, and that could be just as harmful.
> I'm not sure why you felt it was important to explain this to me when I've already demonstrated a working knowledge and at this point I also feel that you ignored a good portion of my previous post that was about strong and weak spoilers.
I'm again really sorry that you seem to have taken this so personally, as I do respect your position. What I was explaining was how Asset Voting works, since I suspect most readers of this discussion would not have heard of it and I didn't know that you were familiar with it. The reason I didn't include anything in my reply about strong and weak spoilers is that I agreed with you and didn't have anything to add. You, on the other hand, completely skipped over the direct question at the start of my comment, asking you to clarify your point on parliamentary systems, but it seems that wasn't important to you.
> That's just making collusion rings easier. Again, let's look at the 2016 and 2020 elections. That's just letting the parties dictate who can run in the elections.
Asset Voting doesn't require the existence of parties at all, and I'm not sure how you think a collusion ring would work, or how the 2016 and 2020 US elections are relevant to Asset Voting. There would be no harm in voting for Kasich in the Republican primaries because he would have been able to assign his votes to Cruz, for example, if he had come third.
I honestly encourage you to attempt it. Create a fake election and test ballot counting with IRV, Approval, Score, and STAR. The last 3 you can actually use the same ballots so you only need two sets, one ranked and one rated (approval would be scores above a threshold).
I am absolutely certain if you do this exercise you will see that the cardinal systems are far easier. Remember, you are doing many of the same operations in both ordinal and cardinal, but in ordinal systems you have a longer outer loop. In cardinal systems you don't have that outer loop (i.e. dropping candidates). The issue is that you're not considering this into your complexity calculations.
Let's look at the algo again, but in a bit more detail.
While > 2 candidates: # This loop cannot be parallelized
- For each ballot: # This can be parallelized by prefix sum
--preference = argmin(ballot) # The highest ranked. This is a lookup on all rows btw
--preference += 1
--update table of candidate score list
- pop argmin candidate score list
We'll probably make this computationally easier by first sorting each ballot's preference. This will reduce the complexity of argmin
Now Cardinal
For each ballot: # This can be parallelized by prefix sum
- for each candidate: # This loop is trivially parallelized (prefix sum again)
-- candidate score += ballot candidate score
argmax candidate score list # You're doing this on the final score (row), not per ballot.
The second is far easier to do by hand and far more easily done by computers. You're just summing columns. Anyone with an excel spreadsheet can do this. Anyone with the spreadsheet can easily read and verify this too. I would not argue that the same can be said for ordinal systems. Take a look at the NYC Mayoral race[0]. Now imagine if Rounds 2-8 didn't exist. Easier to read and compute, right? What's happening inside each round is pretty similar. The difference is if you're doing += 1 or += score. And with cardinal systems you don't have to sort or determine who the preference is before doing the increment.
I'm not sure where the confusion is here.
[0] https://vote.nyc/sites/default/files/pdf/election_results/20...
To give an example of an easy paper-based algorithm, for FPTP you can group each ballot based on the candidate marked and store those as separate piles, and then whichever candidate has the biggest pile wins. Alternatively the piles can be weighed (using a non-electronic set of balance scales if necessary). Also note that the ballot counters only need to decide on the presence/absence/location of a single mark on each ballot, and not decide, for example, whether two marks are "approvals" of two different candidates, or an approval and a crossing out of an approval. These are the sorts of factors which your Excel spreadsheet model overlooks.
I do completely agree with you, though, that IRV/STV in practice tends to be slower than both FPTP and ordinal systems, and its counting process can't be run in parallel, so I would only support it in the circumstance where it was the only reform being offered, and where I was confident that its failure modes wouldn't cause it to be quickly abandoned and used as an excuse to stick with FPTP over better alternatives. Where there is a choice of reform, I support Asset Voting because it retains all the simplicity benefits of FPTP while being resistant to the spoiler effect.
Well, in practice there kind of is. It probably doesn't have to be that way, but just from what little experience I have, I wouldn't hesitate which one I'd rather live in. The more heterogeneous system tends to bring a more heterogeneous culture and with it a wider range of ideas.
How do we bring this to the US?
Edit: One thing I wanted to add is that we can have different groups focus on different things. It's not a zero sum game. This is because not everyone is an expert in everything, and thus the utility they contribute isn't the same as every task they contribute to.
There is a scary (gross in my mind) story that reports on some dystopian pre-crime Minority Report Sheriff targeting kids.
Looks like the court case is in process, though not sure why court didn't immediately shut it down pending trial given how (to my non-lawyer brain) this seems that plaintiffs will almost definitely prevail given clear violations of multiple Amendments.
From the reporting: "Over the span of five months, police went to his home 21 times. They also showed up at his gym and his parent’s place of work. The Tampa Bay Times revealed that since 2015, the sheriff's office has made more than 12,500 similar preemptive visits to people.
These visits often resulted in other, unrelated fines and arrests that further victimized families and added to the likelihood that they would be visited and harassed again. In one incident, the mother of a targeted teenager was issued a $2,500 fine for having chickens in the backyard. In another incident, a father was arrested because his 17-year-old was smoking a cigarette. These behaviors occur in all neighborhoods, across all economic strata—but only marginalized people, who live under near constant police scrutiny, face penalization."
https://projects.tampabay.com/projects/2020/investigations/p...
https://ij.org/press-release/pasco-families-win-round-one-in...
Selective enforcement of laws is a problem, and there are plenty of laws to selectively enforce.
But yeah for sure on selective enforcement = super biased. On race and wealth.
Land of the free. The arbitrary harassment of the population is one thing, but then there is that mountain of actual laws and regulations that would be considered an overreach even by the standards of most totalitarian dictatorships in the world. What could possibly be wrong with having chickens in the back yard?
An old coworker of mine was on a gang registry because of people he associated with when he was a teenager. He was in his late 20's-early 30's when we worked together. Really nice guy, super hard working, spent his free time gaming or hanging out with his girlfriend, got really into his puppy and being a dog owner. Hadn't been around gangsters for at least a decade.
He'd regularly get pulled over and hassled by cops just because when they scanned his plate he'd show up as being on the gang registry. Ended up losing his license for several months because his friend who was his passenger one time had a very small amount of weed in a bag in his pocket when he got pulled over.
Pretty much any time cops are around or even whenever he drives, there's always a chance he's going to get pulled over and harassed randomly.
Not because of anything he ever did, just because he chose the wrong friends when he was young.
"We should track who is gang affiliated" -> "We should track who has done terroristic acts" -> "We should track who is affiliated with terrorists" -> "We should track who may be affiliated with them"
All seem to be reasonable steps, which IMO makes it not a case of the slope being a fallacy.
So... what was it actually used for? Wasn't this the same list that results in extra scrutiny at airports & whatnot -- wouldn't that count as harassment?
Boy, that was the understatement of the year.
The patriot act doesn’t need an edit or another look. It needs to be completely abolished, yesterday.
"Just" dismantle the psychopathic institutions that govern our societies (a revolution) and make sure anyone who attempts to rebuild them is look down on with contempt.
It’s in the wrong hands already - the wrong hands made the list, and there are plenty of examples of what has happened to various misidentified people over the years.
https://magarshak.com/blog/?p=349
In an ideal world, we'd be constantly re-evaluating both foreign and domestic policies, but will we?
Remember this signed by Obama: https://www.aclu.org/press-releases/president-obama-signs-in...
And he was not able to even close down Gitmo
once you give the gov power, it is never given back to the people.
1.9M people is a massive number of people
> The No Fly List is different from the Terrorist Watch List, a much longer list of people said to be suspected of some involvement with terrorism. As of June 2016, the Terrorist Watch List is estimated to contain over 2,484,442 records, consisting of 1,877,133 individual identities.
I would say incredibly massive.
I mean, to get onto that "terrorist" list (if it is of US origin) most probably it means that the person must have traveled to or within the US by plane (or applied for a Visa, or similar), otherwise the fields of passport_id and country_of_issuance can be empty and (false or real) matches only depend on name, surname and date of birth.
In Italy something that is similar to the US SSN is the Codice Fiscale that can be thought as a condensed string based on Surname, Name, Sex, Date of birth, and place of birth (each italian comune, think of a municipality has its own alphanumeric code).
At the time it was introduced, there were of course a number of "collisions" due to homonimy or partial homonimy (the algorithm uses only some consonants of Surname and Name, making collisions more likely) and a provision for an "exception" was made, altering last character (which is a control character and normally is a sort of hash of the other data).
This allowed up to 26 people born in the same municipality on the same day and with same (or similar) surname and name to get a distinct codice fiscale.
For strangers the code for place of birth is instead of municipality the much more generic country of birth.
The amount of collisions with foreigners staying in Italy or however needing the codice fiscale (coming from a few countries) zoomed to higher than that and now there are quite a few "non-standard" codice fiscale where one (or more) of the numeric characters has been replaced by a letter character according to a substitution algorithm 0=L, 1=M, etc. starting from the last (rightmost) number.
This has raised the number of possibilities from 26 to (I believe) 128 or so and for the moment the system still works.
However, last data I could find, is 2016 and there were 36,000 "collisions" on 94,000,000 total, (in 2000 it was some 24,000 on 80,000,000 or so).
I wonder what kind of probabilities there are, if you have a common enough name and you are born in a country for which there are many entries in that list to be "picked" for homonimy, if the passport info is either empty or not used.
For a related example, Russian government maintains a list of banned Internet resources. The list is not public — at least in theory — but there is an official web site where you can input an URL or a domain name and it would response either with "no, it's not on the list", or with "yes, it's on the list, here's who ordered it and when".
Repeat for every name you want to check, and make use of the airlines free cancellation policy so you don't actually have to spend money.
"In the wrong hands, this list could be used to oppress, harass, or persecute people on the list and their families."
I'd imagine being on a list that limits your personal freedom without being charged with a crime and convicted falls pretty squarely within the definition of being oppressed & persecuted before even considering any second order effects of the list being leaked.
Even blueleaks was <1T (~300GB iirc) and many people had trouble downloading it. I am sure many IC databases are several hundreds or thousands of times larger even without indices.
It's not like you could just throw up a 4000TB torrent for a 7z of all of the north american phone call metadata for last year.
Not only is there no practical way for anyone other than maybe Google or CERN to download that much data, unlike the no-fly list, actual classified information isn't attached to any networks that can be accessed from outside of a secure facility. This means the only way to egress data is for an inside threat to copy it onto USB drives or possibly optical media, maybe steal hard drives. But there are pretty hard limits to what you can just bulk copy. It can't be much more than a person can hide in a bag.
I wouldn't be surprised if some other non-us government or 5 has already established this kind of stuff. The amount of computers accessing the classified info intranet would be very, very large I would imagine, such that a few modified computers here and there would go virtually undetected. Just look at all the classified crap abandoned at Afghanistan for example.
Big data is hard to deal with. You can't just download the stuff.
Sure, they can't download the entire database, but a 10 - 100 TB sample of that would fit on a normal desktop and enable anyone to commit massive identity theft and credit card fraud.
"The FBI leaked your name as a terrorist"
What next, the IRS?
Already happened: https://www.propublica.org/article/the-secret-irs-files-trov...
They don't disclosed how many parties were included, but their description of their validation (they verified it against 60-some public figures who had separately disclosed their tax filings) suggests that it's probably a significant fraction of the US population.
https://en.m.wikipedia.org/wiki/Office_of_Personnel_Manageme...
Edit: why downvote?
I rest my case.
The relevance of a national ID is (presumably) so that banks can check identity more reliably, i.e. making security breaches like the T-Mobile one irrelevant. It wouldn't matter if your SSN was public information.
Most states in the current system seem to have a crude biometric identity verification of a photo plus point in time stats of height/weight/coloring, all of which is nominally protected/validated by counterfeit protection. How would a national ID be any different?
My point is that currently, we don't have anything like a national ID.
It is not an explicit legal requirement but encouraged through a coercive network of public/private regulation.
> Is there any legal pressure to keep the data on it up-to-date?
There are legal consequences for failing to update data.
> Are the standards for 'crude state IDs' identical between states or would you have to know the rules and regulations of 50 different jurisdictions?
Yes, within the United States there is a "Real ID" standard promoted across states by the federal government. A business operating in any particular jurisdiction is benefited by counsel regarding localization.
If we're going to treat this magic number like a national ID number, the least we can do is buff it up a little.
On top of that, states have their own ID systems. Typically there are 2 options: just a state ID or driver’s license, that serves also as an ID. Most people in the US get driver’s license early(permits as early as 15), so there aren’t that many who has just the ID.
Now, SSN is issues upon birth. Before you know it, you can already start paying taxes.
For passport you need to apply, typically you would need it if you wanted to travel outside of the US. Otherwise, you rarely need it. This is because for the most part you deal with state bureaucracy, as most of the day to day life falls within state’s jurisdiction. Driving, getting married, divorced, buying things like a vehicle or a real estate, opening a bank account, domestic aur travel, etc. Some can live their entire lives without a passport, because a state ID will suffice. Even for things like voting in federal elections - you don’t need a passport. Contrary to many people’s beliefs, in the US the states vote, not people. This is/was by design. Now it gets more centralized, but the original concept is close to EU in terms of states autonomy. This means, that even for federal elections procedures vary greatly by state (its been on the news a lot lately). Moreover, you aren’t required to have an ID. It is not illegal not to have an ID or be off the grid.
Before 9/11 you could even go to Canada using state ID only. Now I think even it’s possible, probably only if you have some special kind of ID.
This is how things have been until recently. Then REAL ID came around. Because states rules governing ID issuance, they vary greatly. So we ended up with some states’ IDs that were as easy to counterfeit as printing a piece of paper. Some states would not do a due diligence verifying your name or address and would just take your word for it. READ ID is to addresses: mandates minimum protection level, due diligence a state needs to do to confirm address, etc. New federal regulations does not allow air travel with state ID that don’t comply with REAL ID requirements. Few states still don’t, so residents of those states will need passports for domestic travel. I think this trend will continue beyond air travel.
States aren’t required to share this data with federal government or each other. It is, however, a requirement for REAL ID. At the same time there are many businesses, that specialize in aggregating various identity information a out people. Credit bureaus are such businesses as well. They aren’t only in business of credit checks, but also identity verification, employment verification, etc. Some of these companies have federal, state and local agencies among their clients.
Fun fact: you can board a domestic flight without an ID. For example, if you lost it. TSA has a procedure to establish your identity. This includes asking you a bunch of facts about your life, such as where you lived in year X, last 3 cars you owned, your spouse full name and birthday, etc. I suspect they maybe using one of the credit bureaus identity verification product offerings.
https://www.theatlantic.com/politics/archive/2015/12/no-fly-...
So, basically, politicians have found it to be a convenient tool to skirt due process concerns in general when pushing for their favorite agenda.
Anyone who knows bureaucratic behavior knows that even in the absence of real terrorists, people will find their way onto lists like these.
I hope the lists will leak to a wide audience. Find the cases that are wrong and sue those responsible behind the desks. This is the only way this can stop.
The website is extremely horrible. Did use a dev browser without adblock. Grave mistake.
> “it seems plausible that the entire list was exposed”
They are not for you to use to create accountability by discovering inappropriate inclusions and demanding answers.
No, it didn't.
See this comment by grkvlt[0] and another debunking here[1]
[0]https://news.ycombinator.com/item?id=12070156
[1]https://blog.erratasec.com/2014/07/validating-xkeyscore-code...
https://www.gregpalast.com/interstate-crosscheck-on-the-verg...
Teetering on the brink of an epiphany.
"A person who, when trying to criticize those who match a certain description, fails to realize that they have (in the process of criticizing others) revealed themselves to match the exact same description"
And it's hard to tell how much of an implied wink is behind that quote. I know if I'd said it, I'd have done so with subtext.
I'd like my reality unmediated, please
Take the Facebook leak from earlier. Create hundreds of collections if 1.9M people. Release it to the dark web.
Just flood then zone with noise. FBI can still keep their list (and know it’s legit), and peoples privacy will be ensured.
Otherwise this is going to 100% get integrated into various social credit systems we have in the US.
Legal weenies may engage in mental gymnastics to rationalize the evil of no-fly lists.
They deserve the receiving end of their perfidy.
Sorry for the rant
People are fucking stupid, and expecting them not to fuck this up is a big ask. Too big, in fact.
Secure by default or GTFO
If you'd like to read how you can secure ES, go do that: https://www.elastic.co/what-is/open-x-pack
PS: x-pack is the piece that adds authorization/authentication to ES.
Keeping lists secret appears to be something the human race is really really bad at.
I'm not sure about the others, but "selectee indicator" might be whether the individual is on the Selectee list used for SSSS flagging[1].
[1]: https://en.wikipedia.org/wiki/Secondary_Security_Screening_S...
One of my biggest complaints with national security programs is that they tend to argue that transparency (even to the voters and elected representatives whom these programs ostensibly protect) threatens the program. Sometimes when leaks happen, it gives the citizens a tool they didn’t previously have to challenge those programs.
Doubly so. No passwords _and_ it was exposed. There's no real reason to ever directly expose a database to the internet for 0.0.0.0/0. Heck, there's no reason to expose to any routable address.
Yeah sure zero trust or whatever. Still, why even risk it? Layers.
How did this server even have a public IP?
And open the host firewall too, there were quite a few layers of absolute incompetence involved here!
1. Secure by default makes for a higher barrier to entry. It's human nature to want to keep barriers of entry low for your life's work. (I have similar thoughts around copyleft licenses being better for the users but hard to sell to the creators.)
2. Security is "available" to anyone savvy enough to clear all the hurdles to secure the system, so the creators feel justified to blame the user.
3. The product is developed with an assumption that something outside the product is supposed to provide security. For example, the Go.CD devs (excellent product otherwise) scoffed at the idea of improving their crappy password hashing (single round of SHA256 with no salt IIRC), instead suggesting that I should wrap the service in some other, safer authentication mechanism.
https://docs.aws.amazon.com/elasticsearch-service/latest/dev... amazon elastic search gives you the option of encrypting the data at rest (meaning it is encrypted by amazon ES when stored persistently) - they use KMS for key management, so it should have a per record symmetric key that is encrypted by master symmetric key. It's notable that the amazon fork has added this functionality, this does not seem to be part of elastic search proper (please correct me if I am wrong)
Elastic search proper is only talking about encryption in transit https://www.elastic.co/what-is/elastic-stack-security?ultron... Here they say that they don't have encryption at rest https://www.elastic.co/guide/en/cloud-enterprise/current/ece...
Now you can possibly encrypt the records at the application level, but that makes them unsearchable; however the ability to search the stuff is arguably the point of having it in elasticserarch.
three weeks open on the internet; it seems unlikely that no other party accessed it.
NSA: Prism
DEA: Asset forfeiture
FBI/CIA: Abusing fisa and using five eyes to spy domestically
IRS: Political targeting
etc etc etc
Any of you care to comment?
I have had many friends over the years go through prison and put on "terrorism" lists by the french secret service for their political activities. Government is tyranny. Governments only exist to serve the rich and powerful, and ensure nothing ever changes. If you're not convinced, you can look up FBI's "COINTELPRO", of which the current no-fly list program and terrorism-creation program (search for "How the FBI creates terrorists", plenty of documented cases) are just a continuation of COINTELPRO and other FBI/CIA programs designed to prevent the people from exerting their free will and right to organize.
I used it for a while at home for a project, and setting up auth was quite a process, very difficult compared to most other databases.
So even doing official Elastic training still leaves you with a nice footgun.