I guess Gates, Hawking and Stark are talking about a further AI creation, they are kind of long-term thinking guys.
I guess Gates, Hawking and Stark are talking about a further AI creation, they are kind of long-term thinking guys.
It doesn't make sense to me personally why we need subjective experience, nor what it is in a physical sense. We can have agency and variability of choice without it, but at the same time we know how powerful it is in humans. Until we know exactly how it functions, i don't think anyone can claim with any certainty if it will happen, or how far away it is.
Imagine the public sentiment if mass media made people aware of the inevitability of the nuclear bomb 50 to 200 years in advance and people (not just the government) were actively working on developing it.
I think that had nuclear physics been more obvious 50-200 years earlier, it may have lead to a lot more practical private-sector development. In the case of power generation, this is seriously beneficial.
How will private-sector AI turn out? Will they boot up sentient AIs in Docker, then discard them? Is that OK? Who even knows?