Google in 2007: Do no evil.
Google in 2017: Skynet didn't build itself people! We need more ML training data!
Google in 2017: Skynet didn't build itself people! We need more ML training data!
Or will it? If it's an AI intent on approximating human speech processing, why should it be any good at programming? See also https://www.fanfiction.net/s/9658524/1/Branches-on-the-Tree-....
The next step in programming is probably not anything like programming. Machine learning certainly isn't. Creating a neural net that achieves superhuman image recognition takes 30 lines of code in keras. And terabytes of training data. But the programming doesn't look anything like someone in the 90s would have thought. Except maybe for a bunch of AI researchers.
I dont think that an AI will program itself anything like we program computers.
People who "program" themselves really just provide good data. Positive reinforcement, "healthy thoughts", "gaining valuable reference experiences", things like that. When you want to learn a new language, at the simplest level, you can immerse yourself in that countries culture and you will learn automatically. You don't hop inside your brain and move the axons around. You just provide good data and let the engine do its job, and why would an AI be incapable of doing that?
They already do that. "Backprop" is that mechanism. Not yet on a really advanced level, but a machine learning algorithm already introduces its learning back into itself and incrementally improves on that.
That's largely because you haven't looked. Infants are constantly developing and pruning pathways and connections in their brain, which effectively changes both the hardware and the software.
My new prediction is Skynet will come out of the financial bots. It solves the money problem, because those bots will become financially self-sufficient quickly.
Regrettably, the target function is "make money" which will cause our next-gen species to be psychopathic and uninterested in human life, except, in the short term, as a market to be plundered. Not a good outcome.
Exactly! Any sophisticated machine will be as full of errors as a human, just different kinds of errors. Unless it's a Godel machine [1].
v. 0.1 was based on the chip from the Terminator that had been sent back in time by Skynet. Humans otherwise were decades away from being able to design something like that.
I think it's reasonable to say that Skynet built itself.
But ... ugh, rationalist fiction always makes me a little sad. I share the motivation, the annoyance at how pervasive the plot driven unrealistically stupid decision is in fiction. I want to like it, but it's always so saturated with authorial naivete, inexperience and smugness.
I guess I just wish they'd revere Iain M. Banks more and Yudkowsky less.
Definitely. Though Banks doesn't have quite the Internet following, possibly because he was publishing before the Internet took off and compounded by the fact that I can't link to a free, online copy of his work.