The Stupidity of Computers
nplusonemag.com
nplusonemag.com
Whilst it is unable to assign one symbol with multiple nouns, I think these are more engineering issues than anything. The overall architecture of NELL can be made smarter with horizontally scalable knowledge inference additions.
I think articles like this are going to be out of date fairly soon (if not already out of date privately).
[1] http://en.wikipedia.org/wiki/Never-Ending_Language_Learning
That is hilarious!
By the way, there is another intersting never ending lerner which is based on random images from the internet: http://www.neil-kb.com/
eg. A human might not be expected to know too much medical terminology, hence could easily get names/locations/functions of muscles and organs mixed up. Whereas a computer might be brilliant at that, but then suddenly not know what a door knob is (door handle? door knob of butter? etc...)
So ultimately to make a computer seem intelligent the problem is two-fold: Getting a high percentage of right answers, whilst also getting the "right" wrong answers.
Afterall, we don't criticize a human too much for not knowing something like the exact geographic location of a small African nation. But we definitely would if they thought that it was on Mars! It's exactly the same with computers, they're just far more likely to make wildly incorrect mistakes than understandably incorrect ones. So finding a way to mitigate computer mistakes, to make them milder, is every bit as important as eliminating them entirely - a potentially impossible task.
Whereas the uncontrolled randomness of computer mistakes could be horrendous. Hence why I'm saying an interesting avenue to look at in AI, might be to achieve acceptably incorrect answers (acceptable negatives), rather than just aiming for high true-positive and low false-positive rates.
Seems like they should run multiple instances against different but overlapping corpuses and see what they agree on. For all we know, any single person would forget what a door knob is if they had all the information in the world in their brain.
But maybe it already works that way internally, I don't know.
One could argue that humans have a similar problem of errors propagating. Areas that we feel strongly about can bias us against learning in fields such as religion, politics, and, of course, programming language design.
I think that it is possible that humans would make some similarly poor responses in areas that we don't talk about often.
Yet, the machine seems to come from an entirely differernt direction. It has much more facts accumulated than a child and can articulate and process them to absolute precision.
My point was more that perhaps we're a bit too focused on the wrong metric for success. The current criteria set is {positives, negatives, false positives, false negatives}, and we try to optimise for high/low degrees of one or the other in order to determine whether a particular approach is successful or not.
What is then overlooked, is that perhaps we don't need to have a near-perfect positive rate, but instead achieve an acceptably-incorrect false positive or false negative rate. Where the answer may be wrong, but it's not too far wrong. Much like a human might pin a country like India in the wrong place on the map, but wouldn't ever put it in the middle of the Indian ocean.
In summation: Perhaps the key for computers to appear intelligent, is not to be perfectly correct, but to be not too disastrously incorrect.
Have you spoken to some members of the general public and asked what they think? People believe all sorts of wacky things. We are just a lot more tolerant of the mistakes people make. http://www.buzzfeed.com/mjs538/things-americans-believe-in
It is not a trivial problem.[1] In fact representing knowledge as some ontology of human language strings with fixed schematics has its fundamental limitations. In many situations it simply fails, disambiguation is just one of them. For example, trustworthiness, temporal information and newly invented phrases etc.
It understands my commands literally and executes them exactly the way I specified them, down to the last typo. It doesn't try to second-guess my intentions, read my body language, or do any of the thousand other things that neurotypical people do to drive me crazy. After a full, stressful day of interacting with people, interacting with the "stupid" Terminal is a breath of fresh air. I'm sure a lot of other autistic people like computers for the same reason.
If my computer ever began to interpret my words and actions like an actual specimen of homo sapiens does, I'd probably throw it on the ground and destroy it with a jackhammer. When I buy an Intel processor, it's because I want it to crunch numbers for me, not because I want a clone of that thing in the movie "Her".
I wish. I have long been surprised at how poor Amazon recommendations are given that they have a large pool of actionable data: things I have actually purchased. What else could be a stronger signal?
I have even informed them which purchases not to use as a basis for recommendations, or when recommendations they have made are not interesting (at least, those that are made from my page while signed in, no ability to do so with the emails they send).
I preorder plenty of technical books, so Amazon could easily suck more money out of me if they kept me informed on up and coming books by authors I have purchased from, or in the specific area I purchase in. Instead, I seem to get weekly emails about the latest "popular" books in a very general area (e.g. programming).
Sci-fi novels are an area where I need a large amount of discoverability to find new authors - recommendations are very useful. Not so much when I break my trend and buy a stock market textbook.
I've also picked up The Design of Everyday Things by Donald A. Norman. Haven't got around to reading it yet as it's not about the web, more just everyday design and usability, but it came highly recommended.
There doesn't seem to be a way to tell Amazon "Hey this purchase was a one-off, don't use it for recommendations".
"... will increase the hold that formal ontologies have on us. They will be constructed by governments, by corporations, and by us in unequal measure,..."
"We will define and regiment our lives, including our social lives and our perceptions of ourselves, in ways that are conducive to what a computer can “understand.” Their dumbness will become ours."
I think the opposite is in fact happening, that academically for example there was a fixed system, in the UK for example you did GCSEs, A Levels, bachelor’s degree etc., which was something like a formal ontology constructed by government - physics shall be divided form chemistry and both shall be graded from A to E. Now we have all kinds of new forms of education like online courses, Wikipedia and so on so you can pretty much find an educational form to fit what you want to do. We're moving more from a formal approved ontology to many competing ones where you can choose.
I'm not sure where posting on Hacker News fits into this. Maybe it is regimenting our lives, including our social lives and our perceptions of ourselves, in ways that are conducive to what a computer can understand!
His only failure is when he tries to prognosticate. Ontologies are reductive only when they're not contextual, for example.
Another new-ish magazine that I mentally place in vaguely the same genre is The New Inquiry: http://thenewinquiry.com
Thank you so much. Please introduce more to us later.
Um, has the OP ever tried getting a human to easily perform such a task?
Abandoning meta-snark despite it's pleasures, what is interesting is the way in which the semi-absurd example implied a relevant example which I now realize was why I wasn't bothered by the semi absurdity. I didn't really take the words literally.
What was evoked seems to have been the idea of how unlikely it would be that a computer could read the pseudo code and determine that it found the most frequent words on a page without being given the answer ahead of time.
"In fact, the least commonly occurring words on a page are frequently more interesting: words like myxomatosis or hermeneutics. To be more precise, what you really want to know is what uncommon words appear on this page more commonly than they do on other pages. The uncommon words are more likely to tell you what the page is about."
interesting that a kitten or a puppy gets potty trained much faster than a human child.
Imo it comes down to more of a pragmatic question than a philosophical one, though. Unless we actually discover a super-Turing computational system, any machine will be doing some kind of computation that in principle could be performed by any other Turing-equivalent machine. Of course not all Turing-equivalent machines are equally easy to build everything on top of, which is where the "equivalent in principle" part falls short. But alternate hardware models (assuming not super-Turing ones) don't in themselves get you anything that in some inherent or philosophical sense can't be done by a pile of NAND gates.
To the extent that humans and computers are able to communicate with each other, it will be via a cooperatively developed human-computer language that will be influenced as much by the computers as by the humans.
That shared compromise is true today via programming languages and the stilted way we must interact with Google Voice Search and Siri. And while those contours will change over the forthcoming decades, it will continue to be true for all time.
As humans augment themselves with digital computing power and as computer technology itself evolves, things will become very different, but the fundamental disconnect will always be there.
Building Brains to Understand the World's Data (google tech talk):
https://www.youtube.com/watch?v=4y43qwS8fl4
The result is http://www.groksolutions.com/
http://www.wolframalpha.com/input/?i=How+old+is+President+Cl...
https://en.wikipedia.org/wiki/Kosher#Prohibited_foods https://en.wikipedia.org/wiki/Grasshopper#Diet_and_digestion
Ontologies seem like just the tip of the iceberg.
It seems more likely to me that instead of a general-AI we're more likely to be able to map and simulate a human brain within a computer.
Now I'm contemplating what an opposite-of-reductive ontology would look like (if that even makes semantic sense). An ontology that enriches rather than simplifies. It's hard to think about.
What I think is the problem is that humans do not have a clear explanation for how our intelligence works. Is it really that much of a wonder we can't emulate it?
I agree we will likely not be calling these things "computers", if we ever invent them.
But a neuron is more than just an input-output state machine, it's affected by levels of oxygen, glucose, and any number of hormones, proteins, and other chemicals in the bloodstream. An adult human's neurons are each individually shaped by their entire existence up to that point. Alcohol consumption, sun exposure, antidepressant medication, hydration levels, exercise levels. It all affects how they work.
And that's just one neuron. Simulating the brain as a solution to this problem is, I think, out of the question.
Possibly, but why on Earth would you want to simulate that? Just simulate what the neuron is supposed to be doing or would be doing under ideal circumstances.
We still don't know that either.
You arbitrarily impose limits in the definition of a computer and lift those limits in definition of a brain.
On the other hand, "All problems in computer science can be solved by another layer of indirection." (http://www.dmst.aueb.gr/dds/pubs/inbook/beautiful_code/html/...) So if that applies to this problem (after enough levels of indirection) then maybe I'm wrong.
He develops this argument more than I have time to do here: http://www.wolframscience.com/nksonline/page-822-text (note that this is near the end of the main section of the book and rests on ideas established earlier).
Wolfram himself seems pretty bullish on the idea of making computers that think sometime in the future in the section I linked to, in a talk he gave at HAL's birthday party called Hal Isn't Here back in '97, and much more recently in some comments on the movie Her.
As for your question "what are those limits?": In a nutshell, no computer program can ever fully answer questions about the properties of other computer programs. Unlike what GP is implying, that is a hard limit we can never ever get rid of. So if weather is universal, we will never be able to fully understand it!
What Wolfram repeatedly points out throughout his book is that the threshold for such universality is much lower than one might suspect given the complications involved in, say, a Turing machine. And because that threshold is so low, there exists the possibility that much of the natural world that is not obviously simple is exhibiting universal computation.
1. Machine learning is moving more and more towards indirect programming i.e. you program the computer with a learning algorithm and let it work out what to do. Google reinforcement learning, or machine learning. This greatly reduces the programming bottleneck.
2. People underestimate how much processing power the human brain has. Think 100,000,000,000 neurons, each with 1,000 active connections on average and perhaps 10,000 latent connections (which are being updated via Hebbian learning). The connections (axons and dendrites) are the active processing units. The cycle time is .01 seconds or so. Only the very largest computers are anywhere near this processing power (~10^16 operations/second). My current desktop is about 10,000 times less powerful. Now imagine trying to build a tractor with a 1/100 horsepower motor - such a difference is beyond being a gap, it is a qualitative difference.
Given the limited processing power available it is amazing computers can do what they can. Back in the 1980s a large bank was run on the equivalent of (1/10 of a millimeter of brain tissue)^3.
Second computers are intentionally designed to be general purpose and they sacrifice a lot of potential speed to do this. If you were to build some algorithms into the hardware they would get vastly more performance (eg bitcoin mining), but that's extremely expensive. However being general purpose has a lot of advantages. Computers will always be faster at many things than neurons.
On the other hand, just for the fun of it, a couple of other predictions. Here: "true, human level AIs would not be developed until 8Tb RAM sticks would become a commodity". Another: "true, high fidelity, multi-censorial brain-computer interface will never be built".
Wall of text.. ok, challenge accepted!
read
scroll
read
scroll
read
scroll
read
MORE!?...
scroll
NOT MORE I GET IT!
...computers are stupid but at least they don't give up!
Everyone knows that if the information is important enough, the author will find a way to fit it into 140 characters. Well 110, with 30 characters worth of tags.