If your company built a super intelligent LLM, say that could find Alpha in the financial markets, would you make it public to anyone with a ChatGPT subscription?

Of course not! They would use it to trade and would keep it concealed while throwing the public a bone with a less advanced version. Same thing applies as AGI or even as code gen gets better.