Hacker News Reader

Comment by dubcanada | Hacker News Reader

Is it static? If I ask it the same question I asked it a few months ago it gave me a completely different answer. Is that because of some additional context above? Should we be starting fresh chats sooner?

View on HN

There’s _is_ a degree of randomness in its content generation, you can see it in action by hitting regenerate. It’s a statistical text predictor that iteratively selects the most like my word after the ones it’s selected so far, but when there are a few good candidates, it’ll choose one at random.

However, the model is static (it’ll present the same candidate word list until retrained), which is what you may have heard. But the way a response is generated introduces the randomness.

Note: I forget the parameter, but if you get the direct API access you can turn off this and get consistent answers.

It's never been static and there's always been randomness when you regenerate an answer. There is no control of a random seed, so you can get a different answers for the same prompt.

You're right of course that some randomness is inherent, but you can adjust the "temperature".

With a low enough temperature you get essentially the same output every time, with a at most just minor words swapped.

It’s not stactic. That’s the thing about ai, you ask it the same thing it gives you a different answer/different image every time.

That’s not really an issue with AI in general, you can make it deterministic by tuning some parameters if you want (temperature in chatGPT, passing a seed in midjourney etc)

Reply on news.ycombinator.com