Hacker News Reader

Parent Full thread

croes

For the same prompt and same version?

That would be deal breaker if the same prompt gives different results.

Would also make the whole prompt engineering thing pretty useless.

View on HN

I firmly disagree with your latter two statements, but yes it is non deterministic

Yes, same prompt and same version. GPT-4 is especially stochastic, even with temperature=0.

So all these comments claiming that an article about the GPT's responses is wrong are useless.

There are also such comments on this article.

https://news.ycombinator.com/item?id=37361521

I wonder why that is. Maybe they’re A/B testing assistant prompts, or there’s noise built into the architecture somewhere.

There was a post about it a while back. From what I recall, it’s an efficiency/cost reduction side effect, but it could be made deterministic, if they wanted to eat the cost.

Reply on news.ycombinator.com