we know exactly how they work. all they do is use statistical probabilities with limited randomization to synthesize new outputs from massive samples of inputs.
essentially a machine for plagiarizing spam.
gpt, and its general approach, will never have much value other than a few limited fields, because it can never produce anything that wasn't in its original input set and it is incapable of reasoning and analysis.
the world is already drowning is junk information. gpt has very limited commercial applicability because it is the opposite of what people actually want and need, which is a way to filter and analyze the massive pile of information they already have. gpt does the opposite and creates more junk information based on an analysis free synthesis of existing junk.