The Rise of Artificial Intelligence and the End of Code
wired.com
wired.com
If anything, abstraction, ever-tighter vendor lock-in, and improvements in static analysis will kill off many coder jobs.
There aren't too many jobs out there for recreating basic UNIX tools like sed or grep -- soon, this will be true for higher level tools as well, until what you're doing now at your desk as a coder becomes a "tool" or already exists as a library.
It will eventually be like self-driving cars: Not totally automated, but enough to make the job of programming like a modern-day pilot's -- throw it in autopilot, and then step in whenever (rarely) necessary. Then people will realize fewer people are needed to keep watch and step in, and that one person is enough to do the same thing as many people.
When this comes up I often wonder what part is AI going to replace? Will it:
1) Assess a business opportunity, design, and develop, deploy, and operate an entire technology solution?
2) If not that, will it pick up at some part of the value chain above and be able to figure out how to do the rest?
It seems more likely to me that the tooling for workers in this value chain will get more advanced. Some of that might include some computer intelligence that is able to perform some tasks on its own.
1) Assess a business opportunity, design, and develop, deploy, and operate an entire technology solution?"
At all of my software engineering jobs, I only ever performed tasks that accomplished what one would consider a small fraction of one list item here -- "develop."
So to answer your question, mostly no. You're describing something that an entrepreneur does, not a coder.
"2) If not that, will it pick up at some part of the value chain above and be able to figure out how to do the rest?"
Yes, the "develop"-ment (deployment is getting automated already -- Chef, Heroku, etc. -- and operate is also largely automated now thanks to things like cloud computing services).
Case in point: Why did WhatsApp have so few employees for its billion users? Well, automation made launching a web startup (doing (1), as you described) a much leaner proposition.
As you can see, AI is not a necessary condition for automation.
I have no reason to believe these trends will reverse course.
Look, people have been declaring the end to programming since it became a profession. Heck, man, Visual Basic was supposed to put us all out of work.
Good grief, dude.
If anything, Visual Basic is a great example of something that ended (a significant part of) programming.
I don't know too many people these days writing WIN32 C GUIs any more, thanks to my above-described forces of abstraction.
Sure, VB wasn't the best abstraction for graphical user interfaces -- it looks like web was the real winner here, but GUI programming has been "abstracted out" or automated, if you will.
You believe that not a single datacenter has shuttered its doors since the success of AWS?
You think that every single person who was developing game engines for every one off indie game is still doing so after the success of various game engines?
Youre being obviously defensive here. Programming as a concept is obviously not going away, but many segments of the industry have already been taken out by automation.
>the end to programming since it became a profession
Would be as laughably ignorant as declaring the end of manual labor.
It will always continue to be done, but its need appears far lesser over time, requiring fewer people fewer hours to do the same tasks.
Automation isnt a sign on a door one day that says "shops closed, programmers dont exist anymore"
Automation is you slowly taking on more responsibility because technology makes that possible. Automation is the marketing team creating the company's website, because tools like squarespace have made it easy enough for them to do. Thats 1 web development job automated away, there's no pronouncement that we no longer need web developers worldwide, just that for an increasing number of cases, it is unnecessary to hire a specialist.
Software just gets more complex and expands in scope when we can build on top of new abstractions. Each time this has happened we've ended up with more programming jobs not fewer.
Why is it so unreasonable to think that some of these very real "trivialities" can't be automated in some way?
It's just that--a joke. Any employed programmer who copy and pastes any significant amount of code from stack overflow is doing more harm than good.
And googling a problem, looking at examples and modifying them to solve your particular problem is certainly not trivial. When AI can do that for arbitrarily complex problems, we have a lot more to worry about than out of work programmers.
Whoever wrote this article has negative knowledge about the state of AI.
edit:
Its also slightly insulting that this person thinks that the modern programmer spends all their time writing if/else/then statement.
(Years from now) ..."humans can learn to be surgeons, but that doesn't mean they should be allowed to do surgery."
For example:
http://spectrum.ieee.org/the-human-os/robotics/medical-robot...
I suspect that this will be difficult for the HN community to hear, but we must face the upcoming realities.
Though I think the article may be assigning more abilities to AI than is actually feasible in our lifetimes, let us not forget that most back-end developers are doing basic I/O and data manipulation tasks. Put something into a database, get something out of a database. Front-enders are doing layout, animation, sizing and colouring.
The average modern programmer doesn't spend their time writing if/else/then statements, I believe the average programmer spends their time writing GET/SET/EDIT/DELETE flows.
I believe in the next 10 years, artificial intelligence will be able to model and create these basic systems based on human input. UX and possibly even UI can also be trained. A/B testing can certainly be trained.
Those who think programmers can't be replaced begin to sound like the Luddites who felt the loom could not match the quality of their craft.
Note: I am a full-stack developer, I believe 90% of my day job will be replaced by AI in the coming years. That final 10% often deciding what to do or the best how, will likely be the main task.
• Current methods to generate programs fundamentally do not scale. Most practical research is about how to extend small-scale synthesis systems to large-scale problems, rather than synthesizing large programs outright.
• The best way to scale these systems is to make them more interactive. Let the programmer do what's easy for humans and use synthesis for the parts easy to automate. This is another way of saying that program synthesis is less about fully automatic programming and more about (radically) better development tools.
I am confident that we will not have automatic programming systems that can handle non-trivial programs by themselves in the next 10/20 years, barring the sort of paradigm-shifting breakthroughs we can't really predict. Instead, we will have systems that can generate some amount of code and work in tandem with programmers—perhaps through sketching[1], programming by demonstration or just much-improved Intellisense.
The current trajectory is that programming is to become easier, not obsolete. The result will not be fewer programmers but more programmers, largely because people with less expertise will be able to become programmers: think Jevons Paradox[2] for programming.
Programming as a job will change and people will certainly have to adapt, but the job as a whole is not going anywhere.
Recently AI has proved it can beat expert humans at all perfect information games. Go has a ridiculously huge search space, but by using neural networks AIs can learn to narrow it down to a manageable size.
Program synthesis is just like a perfect information game. You have a search space, a state, a set of goals, etc. You could theoretically make it into a board game, and have human experts challenge computers at it.
Past a certain point the structure of a space is what matters which dictates how well any given search strategy will perform, and that doesn't readily generalize across domains.
I have not seen anything that would lead me to believe that results like AlphaGo will meaningfully generalize to such an extent. I still think that it would take more than just incremental work to get from where we are now to scalable program synthesis.
But not actually. Program synthesis is hard even if you have perfect formal requirements. In practice, gathering formal requirements is by far the most difficult task. You're probably better off building a system using modern development practices than trying to collect formal requirements Let alone translating those requirements into code, which is easier than coming up with the requirements but still difficult.
> Recently AI has proved...
FYI, it's not as if the program synthesis folks haven't heard of neural nets... you're giving researchers who actually do this stuff all day surprisingly little credit.
I mean yes good program synthesis wouldn't replace programmers on it's own. But it would radically change how programming is done and make our lives much easier.
I'm just saying that AI is a quickly advancing field and predictions like "not in 20 years" have been defied months later. Applying deep reinforcement learning to tasks like game playing is relatively novel, and has only really started to succeed in the last 2 years.
Already today standard CRUD web development is largely automateable. I already have my own specialized scripts from years of experience, targeting backend, front end, design components, that generate most of what I want with some basic inputs. I imagine most experienced web developers have some internal tooling like this too.
This kind of approach already does replace programmers, and could do so a lot more. But what do you mean by replaceable by AI? How would that work?
What if the person requesting whatever function (report, process, notification, etc) could have this system built without a developer?
That make developers replaceable. I'm not suggesting this is happening in the short-term, but as you say yourself, you use scripts for your basic CRUD development. What is stopping those scripts from moving up market to the point where you are not needed.
Front-end devs who used to write HTML and CSS would have said they where always needed because a computer can't make a webpage. But look at SquareSpace, Wix and the like. Again, this isn't every job, but this is a portion of the market which is no longer served by a person, and that will continue.
The new jobs will be in training and building these systems, which I think is historically how industrialization has progressed.
I don't think that's true at all unless you're talking about 3rd party tools like rails scaffolding. What languages / frameworks are you using by the way?
The boilerplate stuff that can be replaced by scripts is maybe 10-15% of my time anyway. The rest of my time is spent at a much higher level either trying to interpret client requests, trying to help the client decide what they want, making high level design decisions, or adding features that require way to much customization to use automated code generators.
This is much different if we're talking about a language like C where a much higher percentage of my time is spent on boilerplate code. However with newer languages and frameworks I think we're reaching diminishing returns for what can be automated by either the language itself or generator scripts/frameworks.
There is a huge productivity difference between using C and raw PHP when writing a CRUD app. There's less of a productivity boost (still huge though) when moving from raw PHP to something like Rails. And there's even less of a jump between Rails and something newer like Phoenix. I expect that the next 10 years will give us even smaller incremental improvements.
It's more going to be that a lot of the superficial patterns if/then (and quite a lot of scripting) that are being done today will be easily replaced. Not that writing a new kernel or some other advanced job is going to be handled by machines.
In that context I think it's going to go fast and be in our lifetime.
I'm basing this on the amount of jobs and interviews I've been to where the tasks are normally completely uninteresting from a technical stand-point. I now work at a government science and technology research agency and much of the work here is still quite rote.
I certainly believe that classes of automation problems will be done by machine learning but I have a very hard time believing all programming tasks are going to be replaced any time soon.
Build this -> builds -> fix this -> fixes -> change this -> changes.
Essentially, this is a learning model already.
Sure, programming will be more about asking the right questions than implementing solutions. We'd think that'll be easy, but most people have no idea what they want in life, and philosophy is still hard.
The proportion of systems programmers that can writte assembly code consistently on par with the quality of that from a decent compiler (such as Gnu's GCC) is probably less than 1%, and they take orders of magnitude more time to do so. Yet, you do not observe system programmers dying out. They use C (and increasingly, C++, Dart, etc) to build bigger and more complex systems, with more demanding requirements.
Ditto for application developers. We now have this amazing enginees called DBMS, which handle out of the box a bunch of common requirements, and whose reign and management has spawned a new class of job that did not exist 30 years ago: DBAs. Some of those are glorified IT grunts, but many are not! They build (information) systems that are bigger and more complex than ever by translating business use cases into a description that is understandable by the DBMS engine.
I could keep going on and on: web frameworks, game engines, simulation models, etc, etc. The point is that the hard part about this craft is not to know how to make the machine compute some XYZ calculation, it is to understand that computing XYZ is an acceptable way to fullfil a business need within the limits of available resources (in the dimensions of development cost, runtime cost, infrastructure maintenance, etc).
At the same time, you say "We have been there before", but we haven't had the quality of AI that we are reaching today, so in many ways we have not 'been here before'. Let's not forget, there was a time when elevator operators thought they were irreplaceable by a machine. Today, you can't imagine having somebody operate an elevator.
A few years ago you had to be a 'web developer' to build a web-page. It was unimaginable that somebody who is barely computer literate would be able to put a website online. Today, you can run an online store without knowing anything about programming.
I suspect DBAs won't have an illustrious future as machines learn how to model data. Yes, they will need a person to train them, and tell them what to do, but I suspect an AI system can look at all the potential modeling options and give a layperson the option to pick one which best suits their needs, or recommend one.
As far as 'magnitude more time' for computers to do the work, I often find this argument interesting with respect to processing power in IoT. In life-threatening situations, performance is very important, but often as long as a persons time isn't being wasted, it doesn't matter if a machine takes twice as long.
Automating 90% of the work will only make software cheaper, and more in demand, as we are very far from creating every possibly useful software. Developers pay might even increase because of it.
Automating 100% of it is a completely different thing. But well, that's hard AI definition. Software development is among the last kinds of work that will get automated.
The main problem with replacing programming is that programming is constantly evolving. Weebly can do most if not all of web 1.0 and some of web 2.0, but there is still a lot that it can't do. The rapid pace of technology doesn't slow down enough for our automated tooling to catch up. Unless we are talking about basically a sentient AI then I just don't see this really happening unless we are talking about replacing programmers that are barely programmers at all.
Right now development costs per head are sky high. If there's any way to cut that spend, you better believe executives will be all over it. A lot of businesses don't care so much about quality and craftsmanship - as long as their customers are stuck with them they're perfectly willing to ship the most minimal product they can get away with.
There is already a big trend of automation albeit on the IT side and not on development. Where it used to take a separate IT team and developers and DB admins etc there is growing field of devOps with automation. Companies, especially startups are biting into this trend and vendors, especially Cloud vendors are spearheading this movement.
If there is glare of possibility of automating the development, these vendors and companies would have been all over it. This behaviour is not seen, means that this a possibility that exists in distant future.
I think the VP's are more likely to be replaced by an AI.
i started coding in the early 1980's and began coding professionally just after graduating from MIT in 1992. The "guidance counselor" at my high school recommended that i major in something other than computer science because he has read several thoughtful pieces that suggested the job of professional programmer would become "extinct" not because programming wasn't important but because it was too important (to leave to programmers)--sort of like the way many companies 50 years ago had large "typing pools"; these are gone because everyone can type.
looking across the span of my career so far, it seems these predictions are correct, in a horizon sense--ie, we've reached this distance line we pointed to 20 years ago, but there's no horizon there, it's still far in the distance.
here's what i mean: in 1992, my first job involved writing small extensions to numerical libraries, in C and FORTRAN. Probably 90 percent (if anything it was higher) of my time was spent "managing memory"--allocating it, deallocating it, pointing to it, etc.
now, the time i spend on those sorts of tasks is de minimis. So the march of technology never took away my job (the only job i have ever wanted to do) but it did take away 90% of it.
With 90% of my former tasks now handled elsewhere, far more interesting and challenging tasks have taken their place.
this is the trend i see--not the one-sided (or perhaps short-sited) trend described in the Wired post--but a continuous iteration of the programmer's work characterized by swapping well-characterized, routinized tasks for more challenging ones, most of which are would take some thought to foresee.
The Deepmind Atari player is only 1500 lines of code.
Transfer learning is a beautiful awesome thing. You can download ImageNet models trained on huge amounts of data by GPU farms and suddenly you've got a world class image recognizer running on your very own GPU.
Reinforcement learning is totally off the hook. You can make a bot for a random board game that you barely know how to play.
AI will eat your career.
By 2020 global job pool for software developers and user interface designers will start to contract due to competition from automated design/development AI.
Please cite an example where a software design task has been done by machine learning. Something where you start with a specification or description and the automation produces a usable design.
Coding could possibly be replaced by something in a decade or so but I wouldn't hold my breath. We are just getting to compilers and JIT systems that do better than smart developers working at a lower level.
I'm generally considered unduly optimistic about AI progress, but 3-5 years is way too optimistic.
For some business-algorithm tasks with large amounts of data we may begin to see tools like NTMs etc become viable in that time frame.
The majority of large SV corporations beyond Google/Facebook do not make much sense to me.
Dropbox? Why not operate your own server?
Apple iphone? There existed separated out telephone/camera/other technology with superior characteristics for less money.
Many many jobs and companies exist because the barrier to entry is too high for most people, even though to insiders their tasks seem ludicrously straight forward. Dropbox and Apple are just an abstraction layer.
Or to put it the way I heard it on Reddit:
"I went to fix some tech issue with the office computers. They're all 50-something boomer gen types who treat being outside of their comfort zone on their laptops as if they were retreating into a radioactive wilderness. I rebooted all the machines. They worked. They looked at me as if I were a wizard."
Not worried, I'm not a CRUD developer, so I don't see my job going away anytime soon.