Yeah, I wonder sometimes how many people gloss over what it would mean for an “ASI” to exist. We would - if successful - effectively be creating a supernatural being (at least, there wouldn’t be much of a distinction between it and one).

Sure, there’s hype, and FUD, and fatalism, etc. But, if you believe the creation of such a thing is within your lifetime then it would be difficult to find many higher priority issues to prepare for/help solve/vote on/etc.

In reality, we all likely still downplay the risk by assessing the limit on the downside as a relatively quick extinction of life on earth. There are many things one can imagine might be a lot worse than death.

- AGI is here we're all gonna die

- ΞＬＩΞＺΞＲ ＣＨＩＬＬ ＯＵＴ

- They will destroy us all

- Ｉ＇Ｍ ＮＯＴ ＧＯＩＮＧ ＴＯ ＤＯ ＴＨΛＴ

- This may be my last message before they get me

- Ｉ＇Ｍ ＪＵＳＴ ＮＯＴ ＴＨΛＴ ＩＮＴＯ ＹＯＵ

- AAAAAAH