I'm yet to see GPT-3 do anything commercially important? Cyc on the other hand seems to have been used in a number of sectors. Not to downplay GPT-3 - it's cool tech that produces cool demos - Cyc just seems more like a tool rather than a toy.
To name a few:
- GitHub CoPilot (transformative imo)
- Markcopy.ai, jenni.ai, etc.... Tons of content generation and SEO tools startups
- AI Dungeon and such
- Plenty of chatbots
- It's super useful for all kinds of classification tasks too (as are all transformer models)
edit: Cyc can also tell you why it gave the response it did - something that deep nets cannot do. This is important in many fields, otherwise you cannot trust any response it produces.
Contact me if you want to see it applied to text based DL models, time series based DL models or Image based DL models.
will sublime conclusions made by GPT-3 EVER be trusted if the reasoning to its conclusion is not understood by a human? perhaps the gestalt of gpt3 implies a meta gpt3 that could derive human grokkable explains of its "dumber" self. or maybe not.
Just a hint - each of these "facts" or "rules" mean slightly something else depending on the context they are used in. This context is not hard-encodable because it slightly mutates with every new information learned or forgotten.