Hacker News Reader

Unit testing: How would you automatically verify LLM output to a static prompt? Outputs can vary with each invocation.

Temperature = 0 solves a lot of it, but not all. A list of all options solves a portion of the remaining. Not sure what to do about the rest - maybe ask the LLM?

Reply on news.ycombinator.com