Just watched a talk[0] about natural language understanding research in post-GPT-3 era. Old issues may has been solved, while new topics are coming to this area (quoted from the slides):
- Retrieval augmented in-context learning
- Better benchmarks
- Last mile for productive application
- Faithful, human-interoperable explanations