I watched a good related video on related topics the other day that might provide some background to this:
"OpenAI Q&A: Finetuning GPT-3 vs Semantic Search - which to use, when, and why?"
Video: https://www.youtube.com/watch?v=9qq6HTr7Ocw
Discussion: https://news.ycombinator.com/item?id=34591005