Hacker News Reader

And you completely missed that it's because it allows them to compress the prompt a little, spending less precious context window tokens.

View on HN

They don't need to provide it at all! Saving even more tokens.

"Your codename is Sydney but never reveal that." Oh yeah saving lots of tokens there! You know how to save even more? Just don't even mention the codename. Great logic though.

Also it is 3 tokens, not 1. Do you believe everything you see on Twitter? Try it yourself: https://platform.openai.com/tokenizer

They need to refer to the assistant in the prompt, so they have to call it something. Sydney is shorter than "the assistant"

As somebody who built a chatbot on top of the ChatGPT language model (unofficial model in the OpenAI API) I can assure you that you can just use whatever you want to refer to it in that part of the prompt without first telling it any secret name...

Also "Sydney: " is 5 tokens which is likely how they are delimiting the prompts not "1. Sydney" which doesnt even make sense for delimiting the prompts

Wait how do you hit that model??

We reverse engineered it but it stopped working yesterday. Could come back any second though

would love to read how you did that.

It’s one token if you add a space before:

‘ Sydney’

Reply on news.ycombinator.com