What Neurons Look Like as Drawn by Students, Grad Students, and Professors
theatlantic.com
theatlantic.com
For example, one wouldn't expect an EE/Physicist (the professors) who works on designing MOSFETs (neuron transmitters) to be able to draw a wiring diagram (neurons) that the MOSFETs would be used in, even though that EE/Physicist might be called a chip designer.
Of course, a simpler answer is that professors are busier than undergrads so they just put less time and effort into drawing these diagrams. So Occam's Razor?
Yeah, an undergrad, even though this was not a formal exam, would probably feel the need to prove themselves by faithfully reproducing their concept of a neuron. Most professors probably just wouldn't give a damn.
> Tain't what a horse looks like. It's what a horse be.
Utter gibberish at first view, then there are some words you can make out if you look closer and after lots of googling you can remotely comprehend the approximate meaning.
Teaching CS students to use perceptron that can't even change its own behavior is like teaching MechEs to built rockets out of Legos. Sure you can do some cool things with them, but the sooner you move on, the sooner you can make some real progress.
After 2 AI winters, I'm happy to see that many schools like Berkeley are finally starting to combine their neuroscience and AI labs.
It is not generally useful in AI to have some horrifically complicated algorithm that is based on something vaguely realistic, but that nobody know how to make do anything, or update based on new input, or figure out what's wrong when it doesn't work.
Perceptrons have no way to mimic this and instead resort to sending an error from the output units back toward the input units duringing the learning phase. But when we go to use them, the information only flows forward. So you can never produce a dynamic learning system with these Legos. No matter how much super-glue you use, this rockets never going to make it into space. Yet many of these new deep learning neural nets continue to use back propagation for their learning phase.
I never said we needed EXACT models. And, I know perceptrons are simple to model mathematically and have 40 years of research and tools backing them. But after 40 years, isn't it time we try just a little harder to make something that is a little closer to how biological neurons really work?
We have been trying. It has proved to be very difficult to get them to do anything useful, though, which was my point. Dedicated AI researchers are actually intensely aware of the differences between real neurons and their neurons, but getting fake neurons to do anything useful has not been as easy as just "simulate what the neurons do".
There was an interesting breakthrough 6 months to a year ago, some new algorithm that is apparently able to update a more interesting neural net, but I don't know much more than that at the moment.
My point was just 10 years ago, none of my CS professors showed much interest in neurobiology. Fortunately I think this attitude is changing.
It's like if you asked a group of people from the 1930s to "draw an alien", and you compared that to modern people asked to draw an alien.
People from the present would draw the "gray" aliens you see on TV. Are they less creative than the people from the 1930s? No - they're just relating what they think is the accepted or most likely "correct" drawing of an alien.
Then theatlantic.com comes along and writes an article asking "do modern people really understand SCIENCE? Why are their alien drawings all the SAME? Are they missing a significant IMAGINATIVE STEP?"
No they are not - you idiots. Next time ask them to draw an "original interpretation" of some concept if you want them to draw something creative... otherwise people will just draw what they think is the commonly accepted answer among their peers.