Map of an Insect’s Brain
smithsonianmag.com
smithsonianmag.com
I've no idea how detailed these simulation projects and if we are months or decades away from doing what I mentioned
No way.
First, this mapping doesn't tell us how the synapses are regulated - if we could 'run' this the weights would stay fixed forever and that's not how a brain works.
Second, there must be some neurons dedicated to chemical management, and they'd go haywire unless you found a way to deal with them. It's possible the hardware/software is so intertwined it can't be separated. Or maybe it's just complex, regardless the mapping is of limited use here.
Third, you're assuming that the synapses/axons are the only thing that matters. It may well be this is true, but having other processes being involved has not yet been entirely ruled out. If they are, the mapping is incomplete.
Lastly, we don't have the computational ability just yet to simulate even the mapping itself.
The actual precision of this model is: nobody knows, because nobody knows precisely what neurons do / what they react to. We know some of it but definitely not all. But, simulating what we do know, you get quite worm-like behavior, despite whatever flaws exist.
To get a more perfect simulation, we'd need more perfect knowledge of the chemistry and physics, and lots and lots more computing power. It's something that's continually improving, but a lot of shortcuts have to be made to make it even remotely calculable. That'll always be the case, physics is simply too complicated to both efficiently and accurately simulate.
Just as there's more than one way of generating electricity there may be many ways of generating thought.
A fruit fly brain is a better model to simulate in this regard. It's much more "generic", so there's a hope that we can recapture high-level behavior from it more easily.
This is a completely baseless assumption. It is also moot, since simulating even 300 neurons is beyond our current computational power; simulating 3000 is not going to be possible in the foreseeable future.
(Doesn't sound like many?, but I've read that one single neuron needed 100 or so nodes in a deep neural net to simulate. But 300*100 also doesn't sound like many (nodes)?)
Edit: some explanations here: https://news.ycombinator.com/item?id=35113498 (in this discussion)
The neurons in worm directly interact with muscle cells, for example, via peptide/monoamine signalling. Or with "remote" neurons.
This is all possible because neural network of the worms is directly integrated with everything. And the connectivity is hard-coded in its genome.
It's not true for more complex organisms, simply because you can't encode that kind of complexity in DNA. Instead it encodes the overall connectivity structure, so that emergent behavior provides necessary instincts.
Massively simplified models exist, and yeah - we have artificial neutral networks FAR larger than that and they run just fine. But they're so over-simplified that it's fair to call them something else entirely, not a simulation. You can use them to create similar behavior, but they're just following the basic concept of a brain, not how they actually work. Inspired by a real thing, not actually mimicking a real thing.
Kinda like how a door hinge is not your knee, even though they both bend. It's not a knee simulation, it's just something that bends. For some things (doors) that's perfectly fine, and there are billions of them in use. You can't transparently replace your knee with one though, it has biology-juice all over it and needs to handle very different behaviors at times.
For brains: we have no idea. Every brain is somewhat different, but we only have a couple complete physical layout maps so far. No "weights", no specific chemistry per cell, no knowledge of what may have changed before it could be frozen for imaging.
With a lot of work and a lot of extra physical and chemical simulation (a full body in quite a lot of detail), based on that map and what we know of the rest of its body, openworm achieves wormy wriggling.
That's honestly pretty good! And it implies that the connection structure is at least coarsely meaningful in an extremely simple mind, which is what many have suspected but have had no way to verify before. But we know next to nothing about how that individual worm's brain behaved compared to the simulation. The fly brain will be similar - we'll have a bigger and more complex brain to run, more complex behaviors to compare against other flies, etc. It'll provide more evidence in favor of or opposed to the importance of that structure, compared to other things that we don't have enough information on yet.
Basically it's still extremely early days, so it's sorta like asking Stonehenge astronomers whether or not our supernova-brightness-based measurements of the size of the universe are accurate. They can see supernovas too, but their answer has to be "uh. maybe? give us a few thousand years to research it". We need more data and better tools than currently exist.
Could you please explain why not? 548,000 synapses sounds entirely feasible to me.
I'm sure we're not far from making a high-level LLM-ish model of behavior based on those extensive studies.
But the topic of discussion is not that, but making a model sufficiently accurate that you "turn the crank" and it yields similar behavior without any priors of what that behavior should be.
To do that, at a minimum, we'd need for each neuron, the profile of responses to each of the neurotransmitters at each synapse, the excitatory/inhibitory effects of each signal, the patterns of how each neuron reacts to those inputs (i.e., receiving a signal from upstream neuron 489327 does not mean that it'll just pass it downstream, but that it'll decide depending on rate of firing, other current excitatory/inhibitory inputs, etc., if and at what rate it'll send the signal downstream), the rate of learning in each of those neurons... and a bunch of other variables, fully modeled.
Then, compute all of those running through the system, and have it take an input like a photo and output the same behavior, from the bottom up, without hints from the behavioral studies.
What am I missing here?
Change the expression levels of some genes, alter an amino acid here or there, change the input parameters (e.g. make a phenotype that lacks the ability to feel pain), and you can end up with a neuron network that responds subtly, or grossly, differently than another. Put memory into the picture and responses can be learned. Fruit fly behavior permanently changes in response to serious injury, similar to the manner in which humans experience chronic pain. Sure, now this is something that can be modeled, but before the experiment it wouldn't have been modeled.
https://www.sciencedaily.com/releases/2019/07/190712120244.h...
> After the injury healed, they found the fly's other legs had become hypersensitive. "After the animal is hurt once badly, they are hypersensitive and try to protect themselves for the rest of their lives," said Associate Professor Neely. "That's kind of cool and intuitive."
> "The fly is receiving 'pain' messages from its body that then go through sensory neurons to the ventral nerve cord, the fly's version of our spinal cord. In this nerve cord are inhibitory neurons that act like a 'gate' to allow or block pain perception based on the context," Associate Professor Neely said. "After the injury, the injured nerve dumps all its cargo in the nerve cord and kills all the brakes, forever. Then the rest of the animal doesn't have brakes on its 'pain'. The 'pain' threshold changes and now they are hypervigilant."
—-
I somewhat agree with how you described it as top-down vs bottom-up. I think it’s not exactly how I was framing it, but it’s close enough, and it’s a useful way to think of it.
Even in the rest of your comment you’re taking a bit more of a bottom-up approach relative to what I’m saying: you’d be surprised how much we know about how the brain’s gross organization leads to complex phenomena (pick up the latest edition of Blumenfeld’s clinical neuroanatomy if you want the very-high-level summary).
You can, in principle, achieve a “broadly correct” outcome by doing tissue-level modelling of NNs. It’s surprising how much of the brain is macro components, as opposed to micro, cell-level processing. (Of course I’m handwaving a lot here. I’m afraid anything short of a concrete demonstration is bound to be unsatisfying.)
And yes, modeling at the higher functional level can be very useful; knock out the Wernicke's center and speech goes, visual cortex, vision, etc... So, with a more detailed functional description of each level, we may wind up with a model with useful predictive value.
Tho, that said, how does this approach create a truly robust abstraction from the lower level wetware? Would it provide ability to fully reproduce computations? Would it account for lower-level changes in health, hormones, electrolyte levels, neurotransmitter-active drugs...?
- If you model top-down (at the tissue/functional level like you suggest), you'll be recreating the "broadly correct" kind of computation, and you'll be recreating something that looks and feels like a really really bad, quirky and dumb human brain. But it'll have certain human-like qualities that are maybe even difficult to pin down. These would possibly make a ton of mistakes, but there'd be a lot of human-like biases and mistakes.
- If you throw billions of neurons into a bag, you may be able to train them to perform calculations with a high degree of correctness (eg.: ChatGPT, generative art, modern ADAS systems) but when these make mistakes, the mistakes they make will look extraordinarily stupid to a human (eg.: "a human would never have suddenly steered his car into a brick wall like that").
Both approaches can produce extremely stupid results, but you need the top-down architecture if you want to preserve what makes "the human flavour of intelligence" what it is. (I suppose you could emulate the same result with a big enough bag of neurons, but that sounds very inefficient to me, intuitively.)
---
Depending on what you're interested in modelling, you may need to combine multiple approaches, as the brain has multiple layers of emergent properties. I don't think that for most purposes you'd need to go as far as modelling blood contents, but something like it might be required if "embodiment" was an important part of what you'd like to model. There are certain types of things that biological organisms learn particularly fast because they have a physical body that interacts with the real world.
I don't personally believe embodiment is fundamentally required in the model (ie.: I think it's probably possible to emulate the same result if you use a sufficiently large number of neurons), but I think realistically it will be a practical necessity for keeping models and computations as efficient as possible.
"multiple layers of emergent properties."
I think that is the key, right there! And we need to choose which layers are necessary, sufficient, and/or useful for the purpose.
Are you saying this because you've spent time reading and/or researching fruit fly behavior studies? Or for some other reason?
I worked closely with one prof (not my PI) who specializes in the study of mitochondrial metabolism in fruit flies, but fruit flies are not my area of expertise. I know just enough to know that there’s an enormous amount of literature on the subject.
Yes, it's true that modelling just a single cell's interactions with its environments is beyond our capacity.
But here we're talking about simulating how a brain reacts to signals at a higher level of abstraction: we're studying an "emergent" phenomenon. We don't need to model molecular interactions, and we absolutely can model this using artificial neural networks.
This doesn't mean we'll be able to completely accurately model its behaviour, but we should get a lot closer than many HN commenters seem to believe. Biological neurons don't have magical properties, they just have more side-effects.
> we're studying an "emergent" phenomenon
It's like saying that mapping all cells in human organism to addresses in memory will give us emergent human inside computer.
But still at abstract layer we just do not have a model of a working brain, we only have maps of neurons, not an actual "algorithm" or a model of all relevant environment interactions needed for a working brain or a set of "abstract instructions" needed for it to work. I think you are over optimistic about current state of our knowledge if we can't even model organism with few thousand neurons accurately. Imagine trying to do that for tens of billions of neurons and trillions of synapses, especially that we know brain doesn't work like an ANN at all[1].
Sounds more like they're saying: a knee is a knee, it doesn't have any magical properties. Build something that bends, and it will behave like a knee. I don't know how true that is, obviously.
If you're active, knee implants have to be replaced after 15-20 years, because they detach from the bone. Knee implants can harbor pockets of infections because they don't have an immune system. They are also more prone to dislocations.
They are objectively inferior to a healthy organic knee.
But most of the reasons why artificial knees are not as good as the real deal have to do with the fact that they're made of inert (albeit fancy) materials. They don't have the ability to continually heal and do tissue remodelling, which is what real tissue does.
I feel very optimistic when I think about this: we're limited, but I think it's absolutely wonderful what we're able to do.
Hope that reality isn't 50-years or more into the distant future.
Investing the search space, to invent a name, can sometimes be very powerful.
However we definitely have the computational ability to do simulations a fly network. Look at some of the modeling done by the Blue Brain Project or Allen Institute for Brain Science - they do simulations of rat and mice models with hundreds-of-thousands to millions of neurons and exponentially more synapses. 3000 neurons is not that many. If you stuck to non-compartmental point models a 3,000 neuron simulation could probably be ran on a moderately high-end laptop.
But as said before, the physical connectome is only part of the information you'd need do any worthwhile simulations.
Trying to simulate a 3000 cells and 500K connections of the fly brain is not a computational problem, it's a knowledge one. If you can find functional properties to build a spiking/rates model, and data to compare it too; then it would be feasible (although a lot of work) to build and run simulations on the model. But without that extra info, and only using the physical connectome, there would be very little reason to try to do so.
It's not the complete picture though, normally that brain would be in an ever-changing soup of chemicals, which definitely impact behavior... somehow. Simulating that, and even knowing what might be relevant to simulate, will never be complete. Only incrementally better than previous attempts.
"A searchable image resource of Drosophila GAL4-driver expression patterns with single neuron resolution. eLife, 2023; 12 DOI: 10.7554/eLife.80660"
They even got a web sim working by now it looks like https://heyseth.github.io/worm-sim/
(2008. Of course there's been related work since, but I don't know of any attempt to review all the newer stuff together.)
It's like looking at the copper wiring on the motherboard, or the pins of the CPU, when what you really want is the logic from the networked gates (transistors).
Yet it seems we are many, many decades away from being able to extract that in any comprehensible or definitive way.
I need to stop reading neuroscience articles. There's always big proclamations, Like "the neural circuitry behind arithmetic has been discovered!" then you dig into the meat and it's mostly guesswork and hypothesis based on correlated activity and connectivity, no logic to be seen.
This paper did blow my mind though, I hope to see more creative stuff like it:
https://www.cell.com/neuron/fulltext/S0896-6273(22)00806-6?_...
pdf here:
https://www.cell.com/action/showPdf?pii=S0896-6273%2822%2900...
and what you kind of really want is a debugging guide to an OS.
hah hah it is to laugh.
https://www.yorku.ca/science/research/schalljd/wp-content/up...
Yeah all that criticism doesn't go into any detail about actual methodological flaws or issues with the results... It just complains about language and is pretty sanctimonious for such weak and generic citations. Like, those are the sort of citations I'd give as an undergrad and trying to pad a paper to make it seem more authoritative and well established than it is lol.
Were any of the criticisms NOT centered around their irresponsible use of language and about the actual methodology and results? How they cultured different neurons to play pong is pretty amazing by itself to me.
It's an impressive achievement but I'm not sure I'd call that a whole brain. It's a larval proto-brain with less than 4% the neurons of an adult fly.
What's completely crazy in this research is the ability to thin-section fly brains. Thousands and thousands of slices _of a fly brain_, good old physical science at the heart, crowd-sourced to connect the dots (though I'm not positive that's the case in this paper). The open-hardware imaging tools used in some studies like this are also super cool- https://openspim.org/.
For instance, if you expose larvae a rewarding stimulus like sugar along with an odour, they will later be attracted to that odour. That is by definition learning, simple learning, but we have to start somewhere i guess.
Interestingly there is some evidence that the memory lasts through to the adult stage, despite the fact that a lot of the brain is actually rewired during pupation.
I suspect this will be the case because the old microscopic will become the new macroscopic and we will realise that there is yet orders of magnitude more details to make sense of.
That's already the case.
Below the neuron level is the molecular level.
Below the molecular level is the atomic level.
Below the atomic level is the subatomic level.
The last of these is still in the process of being explored and understood by physics, and there it might not even be possible to measure all there is at that level, much less make sense of it or adequately model it.
As Roger Penrose famously pointed out, events at the subatomic level might be critical for consciousness, and we're very far from modeling even all the molecular interaction that happen in a human brain, nevermind the atomic or subatomic interactions.
Just because we "know" the world is "made" of fields doesn't mean that the idea of objects is meaningless.
"Researchers have also mapped 25,000 neurons and 20 million synapses in the brain of an adult fruit fly, but this is still just a partial [map]"
"Human brains have an estimated 86 billion neurons and hundreds of trillions of synapses"
The scales at play here are hard to imagine. This is very interesting but it seems the most interesting facet is the completeness, and not just the absolute scale.
From article Now, researchers have constructed a detailed map of the neurons and the connections between them in the brain of a larval fruit fly. With 3,016 neurons and 548,000 connections, called synapses
"A searchable image resource of Drosophila GAL4-driver expression patterns with single neuron resolution. eLife, 2023; 12 DOI: 10.7554/eLife.80660"
If you map position of every fish in the sea will you have a model of a living sea with living fish and all their interactions (electrical/physics/chemical etc)? Or just the positions of fish in a sea at certain point of time?
The only objective, measurable quantity is information complexity. (And yes, insects have it.)
Mosca means fly, the insect, in Spanish.
"In 2015 researchers Limb, Limb, Limb and Limb published a paper on their study into the effect of surnames on medical specialisation"
10k neurons - e.g. leech [1]
100k neurons - e.g. lobster [1]
1M neurons - e.g. cockroach [1]
10M neurons - e.g. zebrafish [1]
100M neurons - e.g. mole-rat [1]
1G neurons - e.g. buzzard [1]
10G neurons - e.g. giraffe [1]
[1] https://en.wikipedia.org/wiki/List_of_animals_by_number_of_n...
(lists some other animals too)
https://www.janelia.org/project-team/flyem/hemibrain
and a competing effort:
Despite all the hype around chatGPT, I have yet to see any model that asks me a question (without being programmed to do so). Today, my son asked me out of the blue: "Why do people write on paper?" and "What are our walls made of?" and "Why don't we paint our house yellow?". I don't care to live extraordinarily long, but I'd give my right arm to have a quick peek into the future just to see how much of the brain's underlying mysteries will be decoded in, say, 100 or 1,000 years.
I don't care if it's running on silicon or on some brain like tissue, I just care I can 3d print and train human-like thinking assistants.
https://web.archive.org/web/20110312232514/https://www.ameri...
>Engelbart once told me a story that illustrates the conflict succinctly. He met Marvin Minsky — one of the founders of the field of AI — and Minsky told him how the AI lab would create intelligent machines. Engelbart replied, "You're going to do all that for the machines? What are you going to do for the people?" This conflict between machine- and human-centered design continues to this day.
I have difficulty believing Englebart could have been so short-sighted.
Technology has its downsides as well but often it is possible to use more technology to solve problems caused by the use of technology, e.g. filters on smokestacks, fast breeder reactors to solve the problems with nuclear waste, etc. In other words there is a need for more technology, not less. It is also necessary to make technology accessible to more people than it currently is, not by handing out widgets to "the poor" but by enabling those with the will and the capacity to build up their own capacity to produce and use it. It is technology which will solve any problems caused by a changing climate, whether that be a rise or drop in temperature and the resulting effects on precipitation. It is technology which will keep the population from ever increasing to the breaking point simply because people feel the need to have many children since so many of them do not survive past their early years.
[1] ...although there have been plenty of proxy wars in Africa, Asia as well as South-America
Billions would die without those as well.
> Human brains have an estimated 86 billion neurons and hundreds of trillions of synapses...
So, the techniques used for the fly are totally impractical for humans, or presumably any mammal. Anyone know of any developments that may help? Maybe AI could be used to automate processing of the images?
Maybe AI can though
Interesting. Does this extend to humans? Does it offer a plausible biological mechanism for backprop?
I had to double check if I didn't click on a Babylon bee or the onion article just to be sure.