Hacker News Reader

HNHacker News

Top New Best Ask Show Jobs

Comment by CGamesPlay | Hacker News Reader

Parent Full thread

CGamesPlay·

This one doesn't seem to support system prompts, which are absolutely essential for getting useful output from LLMs.

View on HN

You can update the system prompt in the settings. Admittedly this is not mentioned in the README, but is customizable.

> the system prompt

There isn't a singular system prompt. It really does matter!

Copy the OpenAI playground, you'll thank yourself later

Fair point, and it's not implemented that way currently. It's more like "custom instructions" but thanks for pointing that out. I haven't used multiple system prompts in the OpenAI playground either, so I hadn't given it much thought.

You use multiple system prompts in a single chat? What for?

I've run into the same problem with deploying Gemini locally, it does not seem to support System Prompts. I've cheated around this by auto-prepending the system prompt to the user prompt, and then deleting it from the user-displayed prompt again.

Can you speak more to this? I get useful output from LLMs all the time, but never use system prompts. What am I missing?

Sure, I use one system prompt template to make ChatGPT be more concise. Compare these two: https://sharegpt.com/c/fEZKMIy vs https://sharegpt.com/c/S2lyYON

I use similar ones to get ChatGPT to be more thorough or diligent as well. From my limited experience with local models, this type of system prompting is even more important than with ChatGPT 4.

Is there a difference in using a system prompt and just pasting the "system prompt" part at the beginning of your message?

Haven't tested, but having it built-in is more convenient, and convenience is why I'm using these tools in the first place (as a replacement for StackOverflow, for example).

Reply on news.ycombinator.com