Hacker News Reader

I thought fine-tuning allows you do "inject the prompt" only once. https://platform.openai.com/docs/guides/fine-tuning

Ah, the rub is that a fine-tuned Davinci costs 6x a standard Davinci. Interesting. https://openai.com/api/pricing/

Gotcha! Thanks for the response. So if I have, say, 10 PDF files which I plan to extract text from and use to fine-tune davinci, I would have to supply the entire textual information extracted from the PDF file each time?

davinci-003 has a 4k tokens cap, you cannot just 'shove all your information in the prompt.' Can parallelize but then rate limits become a problem. Really curious to hear how these guys are handling it.

You shove the whole corpus in a vector db using embeddings, query the nearest neighbors to an input and inject those into a prompt to pass to GPT.

https://langchain.readthedocs.io/en/latest/modules/chains/co...