Brain Simulation Promised a Decade Ago Hasn't Succeeded
theatlantic.com
theatlantic.com
edit despite working within the project I definitely think a critical view of such large funding is essential, so articles like this are welcome
No. No one has simulated a human brain. All those projects have simulated something that might vaguely resemble some of the brain's structures or operations, but we know so little about the whole thing that it was pretty much a pointless exercise.
HBP has been different from all of them because they attempted to do the true bottom up approach, not feasible without massive resources. As the article states, it turned out that even given the massive resources the task is just too difficult currently.
AFAIK, nobody has ever claimed to be trying to produce a human whole-brain emulation in the style of https://neurokernel.github.io/. It's a problem that is obviously intractible right now.
I don't think anyone playing SimCity thinks there's a whole real city running on their CPU. And certainly no one has a heart attack if you say SimCity is a simulation of a whole city.
We need to have some standard, and I would say the bare minimum is modeling each neuron in an ultra-simple way along with the connections between them.
Great question (to which I have no idea what the answer is). It seems to me that the various attempts are trying to simulate sets of emergent behaviours at different levels of the brain's "stack". I guess, one way of determining the success of a "lower level" simulation/emulation, is the emergence of known "higher level" behaviours?
My day job is building and evaluating such models; we have one on seizure propagation that is entering clinical trial.
The only "model of a whole brain" we have currently is the one of C. elegans, and even that's debatable because it does not model chemical processes which modulate neural activities, and therefore does not provide an accurate input/output mapping (in general).
No, it doesn't predict activity from parameters.
> C. elegans, and even that's debatable because it does not model chemical processes
"the map is not the territory". This sort of criticism isn't even scientific
Not sure what you mean.
For example, we have a whole brain model of rest state dynamics that can represent aspects of data (eg graph metrics such as degree) from multiple sclerosis patients, distinctly from healthy controls. Here, the map is the model parameters, and the territory is the patient's actual brain. The map is deemed useful if its structure represents that of the territory.
http://www.scientificamerican.com/article/the-root-of-though...
Their website is https://nengo.ai and I am not affiliated with them just an alum that took his course.
Human brain is a very specific and complex brain which we do not understand - vastly less than even cities at any scale. And to produce any useful answers, the model has to be accurate to some degree - and we don't know how much. HBP indeed had no question which it tried to answer - it's more like climbing a mountain because it exists.
What kind of neuronal / plasticity models do these chips implement? If they are anything like what others are doing with integrate and fire neurons, these do not seem to align with the goals of the project. You need detailed, compartmental biophusical simulations and not abstracted, approximate models of neurons. Otherwise, we are already able to run such kinds of models with a large cluster.
Several options available but followings are superior to others in terms of capturing the real neuron/synapse behavior with a simple and compact VLSI implementation.
For neurons: Exponential adaptive integrate and fire models @ real-time.
For synapses: STD/STP + LTP/LTD circuits @ real-time.
Nope, you can keep going with the same logic: HH is just an approximatiin of the molecular kinetics and what you really need are the FEM models in 3D with all the protein pathways etc etc.
But this leads to an entirely intractable project. The science lies not in reproducing the exact neurons bug for bug, but keeping only the necessary details, within technical possibility, for explaining some observed phenomenon. LIF and AdEx neurons seem like a good compromise for neuromorphic hardware.
everyone draws the line somewhere, this is yours. Even we take this statement to be true, you still have metabolic networks changing transmitter concentrations, dendritic arbors evolving in entirely unidentifiable ways, etc. The goal of modeling is not to say that every detail is there, but ones relevant to account for specific feature of data.
I've been wondering if dendritic arborization means that current deep learning ANNs are hopelessly far away from biological reality, or if perhaps with deep networks simple ANNs could indeed learn to compute in a similar way to complex biological neurons, just over many layers of artificial neurons.
1 https://www.sciencedirect.com/science/article/pii/S089662730...
I don't mean to be petty, but I read that with a very intellectually dishonest tone: By misleading the goals, we secured funds to do what we really intended which wasn't sexy enough:
Thats grounds to call in the research audit and close things down.
> In 2013, the European Commission awarded his initiative—the Human Brain Project (HBP)—a staggering 1 billion euro grant (worth about $1.42 billion at the time).
10yr run ways and massive amounts of capital sounds like the perfect recipe for black hole a money pit.
I'd rather leave 'innovation' to academia and private industry. If they want to help then make those two things easier, don't try to do it yourself (like trying to pick the winners).
1) https://www.reddit.com/r/chemistry/comments/cgy6uz/comment/e...
I left academia shortly after that (no interest in that competition) for FAANG and got more and better research done in my 20% time than I ever did in academia. I've spoken to many program managers who would love to fdund clever new ideas from creative young PIs, but are under strain to produce a reliable stream of papers from more experienced PIs who train postdocs.
That is not to say that the HBP wasn't widely perceived as ridiculous from the outset by people with relevant technical knowledge. I think the bottom line is that we should respect scientists that are able to cast an audacious vision, raise crazy amounts of money, and then actually deliver, e.g., Christoph Koch/Allen Institute.
https://www.washingtonpost.com/news/answer-sheet/wp/2018/06/...
Pretty much every researcher wants money to fund ambitious projects, but you can't just go around making all kinds of nonsense claims without being able to back them up. The HBP has produced some good research, but for the amount of funding they've received I would have expected much, much more.
Ultimately I think the fault lies within the funding structure. So much of scientific funding incentivizes bold and brash statements and plans, but very little consideration is given towards having the technical ability to execute those plans.
For a project of this size and scope, I would have wanted to see significant investments in computational infrastructure and software/hardware development very early on. At least the investment would have yielded something to build upon. Imagine if the Apollo mission tried to go to the moon with parts built from a Yugo. It wouldn't matter how many smart mathematicians you hire, or how skilled your navigators are, you just aren't going to get to the moon. Unfortunately computational infrastructure just isn't sexy enough to invest in, and I would say as a whole (there are some exceptions), neuroscience leadership just does not have the technical expertise to handle these kinds of projects yet.
Still I agree infrastructure is a really hard problem, which is not going to get solved anytime soon. Just as an example, federated identity across HPC resources isn't even on the table, even though they are working on the next funding iteration. This means you need 3+ accounts to get anything done in the HBP way.
That's one perspective. I do wonder how deep we'll get with understanding and simulating the brain.
"We see all the dots science has shone a light on. Let's now figure out how they're connected and how they affect each other."
That would be cool.
Eg a few decades from now, 24/7 biometrics monitoring at massive scale + machine learning might let us predict complex conditions like Alzheimer’s, Parkinson’s, various types of cancer, etc very accurately and very early, yet we might not be any closer to understanding what causes them at a fundamental level in the first place.
True, but this is like optimism. With the motivation to go through life and do things, an optimist can afford unrealistic goals. Sometimes, that is what pays off.
The purpose of TED talks is not learning. It's getting all the dopamine hits that come with learning, without actually putting in the work.
(This is ignoring people that take a course for social reasons.)
They’re not all bad obviously but it’s not a good place for reasoned, moderate, and calculated predictions, which is the plane where most science or businesses live and die on. When your big ideas hit reality.
Theranos probably had the best TED pitch around, if they ever did one.
Marvin Minsky predicted emergent behavior and recursive effects much sooner. (I think this was in all honesty: not realizing how complex the human brain, and not knowing how hardware would develop.)
Douglas Lenat apparently thought commonsense knowledge and reasoning would be easier.
Ray Kurzweil was often making predictions about hard-AI accomplishments just around the corner, which we're starting to see much later.
Everything we thought was just around the corner is not: flying cars, self-driving cars, AGI, cold fusion, the singularity...
Hype cycles are a thing. I for one don't think we'll see any of these in our lifetime.
Everybody in the field thought this was irresponsible and foolhardy, but good for the field overall.
Long story short, I left for machine learning as everybody else without wet lab experience also did from my lab.
I work for a work package leader for the next round of funding, and the European Commission seems to be demanding a Apollo level focus nowadays.
It seems it’s having trouble even getting credibility with in neuroscience. Which is absolutely necessary if you want the level of talent that Apollo required.
> In 2014, I attended TED’s main Vancouver conference and watched the opening talk, from the MIT Media Lab founder Nicholas Negroponte. In his closing words, he claimed that in 30 years, “we are going to ingest information. You’re going to swallow a pill and know English. You’re going to swallow a pill and know Shakespeare. And the way to do it is through the bloodstream. So once it’s in your bloodstream, it basically goes through it and gets into the brain, and when it knows that it’s in the brain, in the different pieces, it deposits it in the right places.”
I'm on the fence about whether people like this are delusional and actually believe that someday we will swallow a pill that can teach us language or whether they're deliberately pumping hype for funding. I lean toward the latter given that this idea is so deeply and thoroughly absurd I can't believe anyone with any knowledge at all of learning, neuroscience, or information theory could possibly believe it. It's much more ridiculous than the "water memory" claim around homeopathy given that the amount of information we'd be talking about here is orders of magnitude beyond what one might imagine a homeopathic cure would need to convey (assuming homeopathy worked).
(It's a fun book though, I like it. Except for the creepy bits on cybersex.)
Isn't this provably false though ? I don't think the openworm project has gotten anywhere near simulating C.elegans.
I've never understood this argument. It seems about as logical as claiming that the human brain uses about 20 watts of power and so if we can make a computer use 20 watts, it'll become conscious.
Even something relatively simple like "We managed to convert the optic nerve to a signal and strobed the poor mouse into a seizure - would the model mouse brain also show similiar brain reactions?"
If you have the neurons mapped but not the biochemistry the divergence could be very telling even if countless "emulation bugs" occur from the implicit assumptions that lead to the states.
I worked very briefly with some folks who do ML engineering and they were disillusioned to the point of nihilism. They claimed that most of their day was just spent fiddling with weights until they got the magic number their bosses wanted to see, and they were all looking to get out of the field.
previous hn discussion https://news.ycombinator.com/item?id=20465053
youtube interview: https://www.youtube.com/watch?v=nM9f0W2KD5s&t=8941s
have you ever feel that your brain is suffering from overheating?