> providers do not want power-seeking LLMs
Sure they don't.
> do you think training a power-seeking ASI is a good idea?
Do you really think that the major AI firms think this is a bad idea? I think the whole drama people have around ASI taking over the planet is ridiculous and fantastical and, honestly, a way to distract from the real problems of ASI - that is, creating a rigidly hierarchical world with zero social mobility.