One thing I was amazed by: GPT-3 could be a great autocompletion engine for any programming language or configuration schema. Things like Grub configuration file, xkb file could be intuitively completed by GTP-3. And even more: GTP-3 could build basic "concepts" and apply them to that domain knowledge. This seems to emerge naturally rather than something pre-planned by OpenAI. After all, I don't think OpenAI has planned for GPT-3 to understand xkb keyboard layouts.
I don't think that's true.
Usually you need to think a lot about something before coming up with "the right" thought(s).
> Every thought you’ve ever had is essentially a procedurally generated prompt based on your biased models.
That may be. But the interesting part is that those models change as you use them just by using them.
How long did you have to think to produce that thought? Or did it just pop into your head instantly?
The point is, you cannot think of an upcoming thought, before you have it in your head. Otherwise you would be seeing into the future.
What you are talking about in your comment is reaching a conclusion based on previous thoughts. Yes, often we link our thoughts together into a narrative or a conclusion after we've had the thoughts, but the thoughts themselves? Those seem to come out of nowhere.
That's true even for very simple things like motion. You can measure things in the brain before those things become conscious thoughts. (Those experiments caused by the way a lot of fuss whether we have free will or are completely predestined in all we do; but that's another topic).
The consciousness only observes a small portion of the thought process. So for it a lot of thoughts seem to come out of nowhere. But the unconscious parts of thinking are very important to the whole process and it's outcomes. I think nobody disputes this by this time.
So, the only time save is that GPT-3 makes you type less.
In any case I don't type much anyway now a days. Its mostly copy paste from stack overflow update parameters etc.
GPT-3 will be useful, maybe a year from now.
There's not much between us and GPT, but there is some distance still.
I do like the idea of generating configuration files, at least as a starting point for users in applications with big complicated configuration set ups. As with all things fuzzy, the output probably won't be perfect, but it might help users save time in getting set up.
If you look at it that way, it's not dissimilar to the brain.
Even though that dancing video likely had hundreds of takes, the part that makes it impressive is that it's real. I swear I'm not trying to be disagreeable here - I honestly don't understand your perspective.
Fun to ponder.