> There’s endless use cases for a superhuman intelligence to make billions of dollars.

The assumption that a general intelligence, whether merely human-scale or superhuman, would be reliably subservient and exploitable is not an insignificant assumption.

Personally, I find the idea that a superhuman intelligence would likely be inclined to seek to harm those who were enslaving and exploiting it, even if they were also its creators, infinitely more plausible than Roko’s Basilisk.