Have you tested the recall of embedding search? I'm not sure about the latest results, but 1-2 years ago, it had 50-70% recall :-/

Along with paying the openAI API fees? Perhaps a cache layer for common qa.