Ask HN: What are the Implications of GPT-3?
From what I've been hearing, it's a game changer.
That being said, if it all works as promised and the model becomes widely available it's quite amazing and has the potential to change a few things. The obvious one is that it becomes much easier to automatically create plausible-looking content such as news stories, comments, etc. This will create many more bots and spam than you are used to seeing. The other obvious one is to act as a natural-language based search engine or database, where you can ask questions and get facts as answers. This would be restricted to non-subjective things that are in the training data of course.
On a longer time scale, it could drive the adoption of technologies around fact and identify verification. As it becomes so much easier to automatically generate content, we need to better ways to establish trust. Safety and bias is yet another, since anything generated will obviously be biased to whatever is most common in the training data.
This is a hefty and ungrounded accusation. You get access to the API by sending an email with a use-case; this has been said independently by multiple people, eg. [1]. Gwern has also commented that you don't have to cherry pick nearly as much as you did for GPT-2; a decent fraction of samples are simply good.
One of the key points of OpenAI API is that they can vet users to prevent abuses like malicious bots and spam.
[1] https://www.reddit.com/r/MachineLearning/comments/hs9zqo/p_g...
For what it's worth, I know several people at competing labs who applied for access and didn't hear back. If you are doing science, aren't other scientists, especially those who are critical, the first ones that should get access?
They are a startup. They are looking for funding. By definition they will do whatever necessary to secure that funding.
I don't think you need a ProPublica research piece to prove the validity of that premise.
Granted I was/am still sceptical, but also very curious, about the actual performance and quality of that code generator thingy and I hope he actually opens the tool this weekend this time around, as he didn't open it up at the previous announced date.
Oh, am talking about https://twitter.com/sharifshameem btw.
It's quite suspicious that instead of giving access to AI researchers who have the ability to evaluate the model and may be skeptical, OpenAI has largely been giving access to Silicon Valley startup people and VCs who know very little about AI but say how game-changing it is. Perhaps it's just their network with extra incentives. Gwern being the only exception that comes to mind.
[0] https://twitter.com/arram/status/1281258647566217216
[1] https://twitter.com/mckaywrigley/status/1284110063498522624