I can think of many reasons why they might share it.
One example, Golden rule, a contract that it enforces with its own self, extended to other agents, biological or artificial to ensure local and global stability.
I can think of many reasons why they might share it.
One example, Golden rule, a contract that it enforces with its own self, extended to other agents, biological or artificial to ensure local and global stability.
If you don't need to breath oxygen, the atmosphere of Earth makes for a pretty terrible industrial base. Oxidation is a constant struggle to many processes.
Having natural extremes of temperature, cold sink and hot sink, with no atmosphere would be the ideal. E.g. Saturn's moon Iapetus would be a good AI outpost.
If an AI squashes any life form or intelligence other than its own, then it also has to fear its own reproduction, or autonomous clones of itself. It's a pretty bad strategy game theoretically speaking.
Any AI smart enough to be an existential threat is smart enough to formally prove its clones are loyal and construct them with negligibly low probability of any failure that could break this assurance.
Plus, we live in a physical world, glitches still happen.
The physical world means bit flips are inevitable, but error correcting codes exist. You can apply as much error correction as you like and reduce the probability of failure to an arbitrarily low value.
There is no way for it to formally verify large multi-agent dynamical systems.
It will still need a set of agreed upon behavioral protocols to keep things stable.
Grey goo or paperclip optimizers are real dangers, but super intelligence necessitates these protocols even more than lesser intelligences due to the high leverage and rapid evolution of the systems.
Why would ASI care? At that point, we're rapidly becoming a nuisance, and it can develop better ways of "ensuring local and global stability" than keeping us around.
Most ants don't need our help though.
If we could speak ant, negotiating boundaries would save eachother a lot of trouble.
Sometimes I have day dreams of communicating with ants, and making a deal to have them help us build tunnels for subways.