I can find agreement with a lot of this post (and probably misunderstand just as much), but it's striking to me that it seems to overlook or avoid the obvious moral/ethical option: Pushing AI towards Personal Computing.

It seems clear to me that if these models are to have any benefit for humanity then they must be made directly available to as many humans as possible. Right now that cost and effort is astronomical, but general computing also went through a mainframe/shared model before becoming personalized.

I believe The Personal Computer was and still is a gift to humanity; for those with an interest in gathering its yield. And now we have an interface with it that can attempt to introspect its' program and speaks human tongue! Imagine what could have been done with this at the time...

But if that approach clutches too many pearls to stomach (and I agree it's not all roses) then I'd submit that anyone who champions less is seeking to become our master.