Who Will Command the Robot Armies?
idlewords.com
idlewords.com
I don't think we are really in a terrible place. In so many ways the world is better than it was. But we are kind of blind to the problems we are creating. Read this.
It can be very hard, and it involves a consistent questioning of authority. Including the authority of ourselves, and the authority we hold over others.
We can have modern medicine, but we have to trust the people researching it. We can have modern robots, but we have to trust the people building them.
Fear is a great way to prevent people from questioning. But if we learn to question our fear itself, it can be useful to have been afraid.
I like Maciej's talks, they're always entertaining, but at the end of them I always feel not quite satisfied. He is good at presenting well known problems in amusing ways but rarely identifies solutions beyond the hopelessly vague (like "we should all think about stuff more").
He is also utterly resistant to giving large companies any credit at all. Google and Facebook have moved the needle on strong cryptography and anti-surveillance tools more than any other groups, but in these talks they're always the bad guys because they make money through advertising instead of credit cards (which are legally linked to your real name and address: far far worse for privacy than ads).
A big part of this talk boils down to, the US Government can order American companies to undo any protections they themselves create. But this is hardly worth commenting on. It is a political problem and the only solution is for political candidates to appear that manage to appeal to large numbers of voters whilst simultaneously being strong on civil rights and shutting down surveillance systems. Neither Clinton nor Trump seem very likely to do that, but nor did any other candidates. The issue matters to people but it matters a lot less than other issues.
Raising awareness is important - and urgent - work. These problems are not "well known" outside of the HN/tech bubble.
> in amusing ways
Also important, as it is much more memorable than the exhaustive clinical delineation offered by (e.g.) Pro Publica
> but rarely identifies solutions beyond the hopelessly vague
If you don't have a solution to what you see as a critical problem, do you wllow in despair? Or do you raise awareness of the problem in the hope that, individually or collectively, others will devise solutions?
There are two point I would dispute. First, I do give large tech companies (and the NSA!) credit for being internally heterogeneous, and doing good things along with bad.
Second, it would be ridiculous to give Facebook or Google credit for making anti-surveillance tools. That would be like praising tobacco companies for inventing a better cigarette filter.
Given that this is the way technology has evolved independent of any one firm, is it really fair to compare them to tobacco companies?
Google's security team has its hands full just shipping a browser that doesn't unlock the computers of all its users for anyone who can write a heap overflow exploit (which is why you should probably prefer Chrome over other browsers). They are not in fact moving the needle on the problem of protecting their own data from hostile governments.
They were not hired to do anything other than check off stories on a task board, their “velocity” tracked by the system described in Piketty's “Capital in the Twenty-First Century”.
If one of them were to get too invested in the ideas described here, he'd be chastized by the other, or by a manager, or the rest of his team collectively, and potentially replaced.
This is at least part of what people mean when they lament that software engineering isn't treated as a profession in the manner of doctors or lawyers. Many of us may be very smart and able to weigh issues like these, but these things are not encouraged or rewarded or respected by most of the employers.
But at least they'd then be in the clear, ethically speaking, and their employer will be on notice that this is not cool, even if they do eventually find someone willing to carry out their unethical deeds. If no one stands up for what's right, the managers will just be reinforced in their belief that they can do whatever they want.
Most developers are in a much better position to stand up for this sort of thing than people in industries with less worker demand. If my company asked me to do something unethical, I could quit on the spot and have a new, better job in under a week. No, not all developers are on such good footing, but there are many, many categories of job where employment security is so low that quitting over an ethical quandary would be unthinkable.
When a paper trail eliminates the possibility for management to plead ignorance and shift blame later, management often happens to grow a conscience.
This is an apt analogy. You may have just driven that point home for me. Do you think that pharma and health insurance companies want doctors to think about what's ethical? Likewise, do law firms want their lawyers to think about whether an IP shakedown is ethical?
My takeaway from this talk is that I'm a Chad. Greater forces in my industry may expect me to sling code and ship features, but my role in this whole mess is to stop and think. Or not.
Otherwise it's going to be kind of a dice roll--what are the values of the first team to achieve the governance-eclipsing technology.
So like all history until now.
The winners dictate morality. Nothing will change.
For me, the most interesting revelation in the recent Wikileaks dumps is the surprising willingness of prominent individuals to share their most private thoughts via gmail.
Larry Page (or his unscrupulous AI successor) may already have enough blackmail material on hand to seize the levers of power, if he so chooses.
In that case, Google's new motto could be, "Absolute power corrupts absolutely".
To me this is the most plausible direction.
Personality characteristics, like "The Dark Triad/Tetrad," do a better job of explaining tendencies for misbehavior.
My point is that exploring and conveying "morals" is actually one of the primary functions of literature. I can't tell if you agree or disagree with this. But if you believe that something being "fiction" means it's not worth paying attention to or that it cannot offer valid moral instruction, well, you are a tremendous fool.
Whether you agree or disagree with the moral or ethical argument being made is a completely separate point.
> That a moral lesson is taught through story does not make the moral taught true in any sense.
I never said that a moral lesson appearing in a story makes it "true". That's a stupid thing to even suggest. You are, however, suggesting that any moral lesson in any narrative that isn't "true" (would you mind sharing your definition of true so we can determine how we can come to that conclusion?) cannot contain a valid moral. Which is absurd.
Edit: Oh! If you liked Daemon, check out Nexus. Same "problem", different core tech solution.
Inevitably, when the technology will have gone mainstream, programming a robot to do something will be done by a junior technician at some random anonymous supplier in a developping country who cannot even read the documentation because he doesn't speak a word of english. That's how you will end up with your cheap butler/cook robot purchased on amazon, chasing the house dog with a butcher knive shortly before dinner.
If Internet of Things teaches us anything...
Giving a feeling of power to the losers is a #1 step to creating an obedient army. Ask any dicator, populist, or army leader.
I'd find some agreement with you that logically we're the dumbest possible intelligence, because the trend is up and we're at the beginning, except we're not at the beginning, people like the Sumerians were. Except they're not the beginning, either...
Collectively, yes. But individually, not so much, considering how hard it is to replicate human abilities in AI.
Seldom Smith, from The Monkey-Wrench Gang by Edward Abbey.
-- Agent Kay (Men in Black)
A robot army could be built to obey only one. And a factory of robots can make wealth without people.
Even assuming we solve the weak control problem, we are about to enable unprecedented capacity for absolute power.
So the solution is to give robots the rights to vote?!
See this is why we need groundbreaking advancements in deep learning and we need them now.
So nowadays, I look more favorably at tables again.
I wish I could use something like QML for layout (anchors that connect elements to each other, grids for when you need lists/tables/columns/grids).
https://developer.mozilla.org/en-US/docs/Web/CSS/CSS_Flexibl...
So perhaps the story is, more precisely, "when it comes to layout, abusing floats is fundamentally flawed" - yes, in the past, tables may have been the best alternative in a lot of cases; but now we've got it, flexbox is superior to floats and to tables. It really is a joy to work with once you get your head round it IMO.
Let's run with the conclusion a bit - What would society be like for there to be a critical mass of critical thinkers, aware of new developments, in a position to act and motivated to speak up?
The cynic in me sees that list and despairs. How can we expect the average parent of 2 to keep C-SPAN on throughout the day, calling their senators on lunch breaks, and boycotting products that would give them an extra hour back every week that could be spent playing with their children.
That's how it would look, right? Instead of skimming political/technical news that entertains us while validating our viewpoint, we'd be parsing legalese like it's a pull request. Instead of binge watching Netflix, we might be driving to a store to buy something that could have arrived yesterday via Amazon Prime.
It's all quite doable. It's just not immediately comfortable. It's also not a priority in our lives, since it's so easy to prioritize anything else with immediate feedback or gratification. However, humans are very good at internalizing and normalizing. When motivated, we can make virtually any behavior livable, or even comfortable.
So that's the trick. How do we normalize critical thinking, due diligence, and active engagement?
We would be amused into slavery.
On the other hand, maybe it's actually ok to not pretend to have all the answers.
https://en.m.wikipedia.org/wiki/The_purpose_of_a_system_is_w...
After all, that is what we incessantly task the government with doing. "100% employment", "create jobs", "create jobs"!
This talk takes an interesting historical dive into how democracy arrived and how it may be destroyed by the machines and weapons we're building. Fun stuff!
Root passwords will be handed down eldest son to eldest son.
To nitpick this totally inconsequential point: you could use a Pokémon Trainer Club account instead of a Google account if you wanted to. Most people still chose the convenience of logging into their existing account instead of creating a new one, though.
The other day, I heard a guy joke (in very bad taste), that when there are no more jobs left, there will always be prostitution and slavery. It's a sick thought, but how far off is it?
Other than that, really enjoyed it.
Here is a picture of what I'm seeing: http://puu.sh/sodrS/17a88ea8b9.jpg
So I suspect we'll get a situation where everyone from the police and military to political groups, companies (mostly larger ones), richer/more tech obsessed civilians and criminals have access to military grade robots. Like a more expensive version of firearms in the US.
Contrary to what tech philosophers have been spouting from their ivory towers, there will be no positronic brain, nor will the 3 laws help one iota once a robot has been hacked.
All it takes is one deranged soul with a little know-how and a desire to see the world burn. Tweak the AI a bit, and now you have a robot that looks for signs of breathing, and then beats, shoots, stabs, and smothers until it stops breathing. Recharge, repeat.
[By nobody I mean, of course, "nobody except for governments". Which maybe explains where these people migrate to.]
Why are people wasting time on this stuff? The "free market"?
― C.S. Lewis
[I was going for a chuckle here]
What?! How many news outlets endorsed Trump? How many fired people because they're making less money? Unless Macedonian Facebook spammers count as "media" these days, "the media" has less money, less reach, and less influence every year.
http://www.npr.org/sections/parallels/2016/08/19/490515026/i...
Edit. Another source (of many):
http://edition.cnn.com/2016/10/13/politics/russia-us-electio...
The amount of anti-russian nonsense coming from DNC/Clintons and liberal is off the charts.
And please point out when WikiLeaks was wrong. Go ahead, I'll wait.
i'm totally willing to believe that russia obtained the emails and gave them to wikileaks -- it's far from proven, at least on the public side of discourse, but it makes sense and doesn't seem impossible or bullshitty to me. but that doesn't mean that the emails aren't real. it's foolish to cover your ears and ignore things just because someone you don't like said it.
wikileaks has also published much, much more than the dnc/podesta emails, from a very wide variety of sources.
Yet we've seen zero evidence for it. Blaming Russia is convenient for DNC since it shifts the dialogue from the emails to "evil empire" that's supposedly behind it. First, they attempted to claim that emails have been tampered with and then when DKIM signatures proved that hypothesis wrong, they shifted their tactics.
Funniest part of that whole election was the claim by Dems that Trump has some kind of a secret server that communicates with Russians. Laughable. It's all just a misdirection.
https://www.crowdstrike.com/blog/bears-midst-intrusion-democ...
there were also, iirc, at least six other private security companies that came to the same conclusion, who weren't hired by the dnc. additionally, every US intelligence agency backed up the claim.
again, not a proven statement, but there's a substantial amount of evidence we're aware of.
>First, they attempted to claim that emails have been tampered with and then when DKIM signatures proved that hypothesis wrong, they shifted their tactics.
do you have a source for the first part? afaik it was just twitter randos floating the idea
i'm not a partisan in this fight. i didn't vote, i despised both candidates, but i also think both sides can be a little blind in their eagerness to paint the other as disingenuous. i'm very interested in this subject and it's one i've followed closely, and i'm reasonably sure russian state actors were behind the dnc and podesta hacks, but i also think it's worth keeping an open mind as a general principle and not to be blinded by ideological alliances.
+1
I don't think our society's adversaries are passing laws by showing up to court themselves.
I don't know where the line is between armed robots and CCTVs meant to control us, it feels very blurred to me.
There are already a lot of robots in the world, just as there is already a lot of software. Indeed, Hollywood likes to depict robots by starting with a human mind and warping it, but a better intuition is formed by remembering that robots are software with physical outputs. They aren't going to spontaneously develop new abilities unless they have been created to.
Some people are inclined to develop software carelessly. "Move fast and break things" is a sensible motto for someone at the center of building social media from nothing. That's only one engineering culture, though. Visit labs in heavy industrial R&D, in academia, in defense, listen to open source developers' chatter, and you will see plenty of people write books on whether a single line of code should say this or that. Cheer up. It isn't all maximum velocity startups. :)
Software - and robots as instantiations of software - is not good and it's not evil and it's not careless and it's not careful. It can be any of these, because it is a reflection of its creators. Like all machines, it amplifies their will.
I very much expect robotics to follow the same path that automation before it always has.
In the beginning, industrial machinery was dangerous to the workers who used it, being first generation tech designed only to get a new job done. As the decades wore on, the machines became safer, quieter, smarter, more predictable. Best practices and required safety protections developed, and now industrial machinery maiming someone is a scandal.
Machines of warfare were once indiscriminate. The buzz bombs and incendiary balloons of the second world war would be considered terrorist weapons today. The weapons that kill indiscriminately after a conflict ends - the land mines, the chemical weapons - banned now. Sure, they're still used by those who don't care about their moral reputation, but it's the sort of thing that makes the international community talk about putting together a coalition to overthrow your government. Nobody does it lightly.
Would the militaries of the world make the same mistake with robots - not retaining control of every kill? Putting an experimental-ai long-lived robot behind a weapon where it might kill for all the wrong reasons after a conflict is over? I seriously doubt it. Too many people would see such a thing as a land mine, and rightly so. A military that didn't care about their moral reputation might do that, but that doesn't make responsibly developed military robots bad. Machines reflect their creators. I very much expect that whatever mistakes the militaries of the world make with robots will be new ones, not easily foreseen. And that as we get better at the technology, we'll correct those too, and ultimately - just like our industrial engineering, just like our software in general - they will be as safe, and as dangerous, and as predictable, and as smart, and as useful, and as directly controlled by humans, as we as a society want them to be.
Mature technology doesn't look like Facebook. Never has, never will. It looks like Apache - something well-considered, controllable and safe, something which does a job so reasonably and so well that it's boring to everyone but the geeks who work on it. :)
Robot armies will be controlled by everyone, and they will be as unremarkable as the robots I control now: my quad, my 3d printer, my washer and dryer, my car. Dangerous if misused or badly designed, but these things are are avoidable, and beyond that - safe, convenient, nice to have.
The South Koreans and Israelis are both working on automatic sentry turrets and the Israelis have actually deployed such systems. This is probably the closest analogy to your "land mine" but we're still OK with it.
Ender Wiggin
better keep your programmers happy
Problem eliminated and no other unintended consequences as far as I can see.
Turn out Youtube didn't manage to stop him.
J. R. "Bob" Dobbs?
If so, pardon my intrusion, and abundant slack to you.
PID 1.
Huggies tried to make a similar sensor to detect when the diaper is full of shit, but it proved impossible to distinguish from normal activity on Twitter. "
I know this is provocative, but many occupations Are simply busywork.
I do think robot armies can be hacked, so try not to Centralize everything.
I find this ... part of a paragraph, highly unnecessary continuation of the previous sentence! And I {object (to this! it = Slavic}; my accent is (fine; (fuck you too = _Writer_; ... i ment...; ...; Nevermind! [:Reader])!
Yeah... fuck your wars, I aint hating Americans for that, and I ain't "pulling out a gun" { missing word -> due to rising _(<<anger-ining>>)_ feelings or something...; Fuck you = _Reader_??!$!$> $T@$ @$) ) )!# _ }; fuck fuck fuck you!...
edit: in-before: whatever: I don't care about points, and this is not a language, this is just a fuck off to the OW {Original Writer}; of the article; Fuck _off_; ... yeah.. fuck you... I'm fine... k... bye
jhet is; A language utility; that I develop; .
jhet is A language utility { that I develop }; .
~ jhet is A language utility that I { develop | create | screw around...} .
~ jhet is PROBABLY a language {Some Kind of English, but not the same... read -> https://en.wikipedia.org/wiki/Bracket#Curly_brackets -> It's basically BRACKETs { of the ENGLIH lagn } that is/would be; !#@ %R whatever... I am showing it off right now may be for the first time..
~ jhet is a language utility; (that would help you); (if it existed {but it's not}); with Languages; Kinda like DrRacket... So JHET would be (may be) some kind of SLANG for RACKET { in DrRacket };... yeah, complimentary to the Racket whatever { "it" may be}... Just __imagine__ YOU'RE INA STRING {of data}
~ The Language:: Language:: The language has a working name as Charm {as in SPELL-cast-ing | _goofy_ I know, but its a good name! yeh... }
~ Todo: jhet { "jhet" is just a word-hack right now... a w-rack if you will :P
Term: To wrack IS To hack words. Word-Hack
edit: don't mind me, I am a grue hick!ufblargh eatin' ur bear, drinkn ur weed, ae overloaded ae ae wha-a-a! ae ae ea ea
edit.2: fucke' script bot hci downvoii mi poem postage * blarkhuiar ada da ad add ad add ad
edit.3: fucke' h'p'str's''.. ur ppntd... blarrah ghr355 3
~ please don't frown, | "+1" I wasted One Reader's Time. (At least one reader... that's what I _think_)... Damn it I am bored again...
~ please... I never meant to Scare you with my Slavic Shout...; ПОБЕДА; КАЗАХ АЗ! ПОБЕДА ПОСТИГАМ май...
Ч Човек съм аз... Българин... и статията е "обидна" за Славо-говорящи индивиди. Fuck you _READER_ (I want to fuck you... fucking is a nice word sometimes) I want to make LOVE to you {what i meant}... this text wants to make love to you {that is}... Attention Vector... Vector... Viktori.. Viktoria. Vicci... I won an imaginary battle...
~ bye! See you soon { Honest-ly I don't know what Im typing right now, I'ma grue in the dark eating your "whitespace" "::white:space:"
~ ISness is bad word :you { skip (Subject| Object | RelationSHIP { a type of Predicate!} ++ "like"}; that; just read <<jhet>>isson; all meaning ...
~ You can form a better Sentence including the word "perl"
For instance: Is this "like" Perl Is this "like" Perl in what ways ~ Fuc@ $ @ $@$@$! %(!#(%!*#%!&%#&!_# )U! <<This part is retracted|has been edited with 'cut' operation>> k your Ego _Reader_, it doesn't matter { 'cus. It's just boundaries { between Person-als }... } ... so on... someone; close the door; "SLAVIC" idiom in English; някой да затвори вратата; <- this was a word in SLAVIC... ... ego is still angry at ME... Ego... SHUT THE GELL UP.. HELL IP UP... Shut the Fuck up; ... brainstate: normal; meme:: The Terminator mblabla bla
~
~
edit: I will re-edit this, upon request :P Have a good time Reader, This wave of thinking-outloud-advertising-response-to-insults-is-done-
Count thy Scores! The Game is ON
~ No, it's not on...
~ Everything under the TILDE can be DISREGARDED as meaningful and malformed but By god { if it exists }; those are {were?} my Honest Words on this Topic -> War Tech.
> We, on the other hand, didn't plan a thing. > We just built ourselves a powerful apparatus for social control with no sense of purpose or consensus about shared values.
I strictly disagree. We must never forget that just because (perhaps) you and I reading this didn't contribute to this system with a sense of "purpose and ... shared values" that someone else didn't. And we must not forget that those values may not be in accordance with our own.
What appears to be a disorganized mess on the surface may have a much larger design, it's just probably not your design.
Full disclosure: I'm one of the founders.
[edit] We're also looking to hire and work with interested. Just hit up /careers and check out what we're looking for. Also, I appreciate just working with hackers, so if you don't see something there that suits you, hit me up and let's chat. :)
What you're making is no different than what Maciej talks about, and just as naff.
More connectedness is not more good. I explicitly would NOT want a no-name company having ALL of my data and seeing everything that I'm seeing. It's bad enough that Google knows everything about me.
Maciej has another excellent talk about how the half-life of data is basically infinite. So while YOU may think you're a benevolent public benefactor, when (not if) you resell my data to the next guy, he may not be. Also, what possible benefit does it bring to my life? Book appointments? Tell me the weather? Why can't I do these things the dumb way?
Progress for the sake of progress is the ideology of s cancer cell.
I'll respond in-line to your comments:
> Are you fucking serious?
Yes
> Did you even bother with the article at all?
Yes
> What you're making is no different than what Maciej talks about, and just as naff.
Why should it be different?
> More connectedness is not more good.
Why?
> I explicitly would NOT want a no-name company having ALL of my data and seeing everything that I'm seeing.
Every company was a no-name company before they had a name.
> It's bad enough that Google knows everything about me.
But you continue to invest in that dataset? Help build a company of trust. :)
> Maciej has another excellent talk about how the half-life of data is basically infinite.
I'm well aware that data on the internet is indelible. I myself have some cringe worthy usenet posts from when I was a kid. :)
> So while YOU may think you're a benevolent public benefactor, when (not if) you resell my data to the next guy, he may not be.
I think the old model of reselling data is gone, building insights through models is really the future, and that better helps serve everyone. You're arguing against the local max we've stumbled into. That's not what we're working towards. In addition I'm slowly working on creating a way to participate in personal and generic model building and transactions without publicly identifying the agents involved.
> Also, what possible benefit does it bring to my life?
Who knows just yet. It's pretty easy to imagine that building a foundation of predictive models around your life might help better serve to help you acknowledge things previously your biases perhaps prohibited you from observing. Knowledge of self is the path to mastery of the self. :)
> Book appointments? Tell me the weather? Why can't I do these things the dumb way?
In the most naive cases, sure. You could still do these things the "dumb" way, but what is the "dumb" way to you has most definitely at one point been the "new" and "scary" way to the generation before you.
> Progress for the sake of progress is the ideology of s cancer cell.
I would implore you to read : http://www.lettersofnote.com/2012/08/why-explore-space.html
My favorite quote being: "significant progress in the solutions of technical problems is frequently made not by a direct approach, but by first setting a goal of high challenge which offers a strong motivation for innovative work, which fires the imagination and spurs men to expend their best efforts, and which acts as a catalyst by including chains of other reactions."