I do not. How does super human intelligence, on it's own, represent any sort of risk for "humanity?"
> then the recipe for how to make AGI is of itself an infohazard [...] nuclear weapons
I know how to make nuclear weapons; however, I cannot enrich the fuel enough to actually produce a working version.
> and yet we regulate its access
Does that actually achieve what it claims to achieve?
> Do I trust OpenAI to make all the morally right choices here?
OpenAI has a language model. They do not have AGI or anything approaching AGI.
> No, but I think their incentives are in fact more aligned with the public good
We could debate that, but for your assertions to hold any water, we'd have to agree that they're incapable of making mistakes as well. Far easier to skip the lofty debate and recognize the reality of the world we live in.