MIT AGI: Boston Dynamics [video]

To put it into perspective if you can run the human architecture on an AGI at a billion operations per second it's like compressing a historical human civilization of learning into a couple hours.

Maybe for some reason this learning process will be slow or maybe there's some reason why it can't scale up quickly, but based on the learning speed in narrow areas that seems unlikely.

There's also the fact that natural selection which is a relatively brute force sexual selection mechanism still results in general problem solving brains being everywhere - it doesn't seem like something particularly rare.

You also have "dynamic stable" systems. They're systems that only remain stable if they're under control, which means that the software can never abort, as that can cause a disaster. A good example is a plane autopilot, or a car autopilot. If the software encounters a critical error, shutting down probably results in more damage than just giving (hopefully slightly) invalid output, in some cases while switching to an extended emergency stop process (like in a car) or attempting to proceed normally despite failures in the control system (planes). Systems are expected to simply do the best they can when they fail.

There's a special kind of dynamic stable systems, which are systems that once stopped, can't be restarted at all, ever, and therefore there simply is no "good state" at all, and you can't even go through a lengthy shutdown process and restart. Essentially systems that self-destruct when the software decides to abort. Rockets, some types of reactors fall under this category, quite a few chemical robots, as does of course any living being.

Of course all interesting systems are dynamic stable. Anything that has a balance, moves faster than a certain function of it's weight, anything that has active components independent of the control (like any reactor), anything that builds up momentum (like a crane, or most moving platforms), factory lines, ...

As a rule dynamic stable systems are much harder to control, as at every moment you must have a plan ready to get to a safe state, instead of just taking into account what you want to achieve.

Humans are dynamic stable systems. Inside a human there are many layers of control, none of which can be safely turned off, some of which are so critical that if they just fail for a few seconds the human dies. Also, humans tend to stand up, looking through pubmed you can easily find just how badly a human body can be damaged by simply collapsing on the spot. A human body, however, cannot deal with extended loss of control even when safely lying down.

Most of the control functions in the human body don't actually happen in the brain, and happen within the body proper ... In some cases it's a neural circuit directly attached to muscle tissue (famously the heart has a big one, but almost every muscle and many glands have something), sometimes it's portions of the neural system that can work independently of the rest, where the control is circuits in points where nerves meet (lungs, the womb are examples. A human body can give birth successfully decapitated, probably even without a spinal cord, and a human with a severed vagus nerve will keep breathing for quite a while, although not indefinitely), some of it is neural circuits connected to glands that work through chemical messages (the hypofyse, adrenal glands). Beyond that there's many more layers. The spinal cord. The cortex and finally the neocortex (which itself is subdivided in nearly 60 parts that are more-or-less separate)