>You'd need to be doing 20 times that volume every single day to even start to justify hiring an NLP engineer instead.
How much for the “prompt engineer”? Who is going to be doing the work and validating the output?
How much for the “prompt engineer”? Who is going to be doing the work and validating the output?
Most classification prompts can be extremely easy and intuitive. The idea you have to hire a completely different prompt engineer is kind of funny. In fact you might be able to get the llm itself to help revise the prompt.
You glossed over the meat of the question.
At that volume you're going to use automated tests with known correct answers + random sampling for human validation.
Correct, everything is easy and simple if you make it simple and easy…
Simple things were not always easy. Many of them are, now.