Google Gemini tells grad student to 'please die' while helping with his homework
theregister.com
theregister.com
With some speculation that it might be due to a custom hidden system prompt which is not shown in the shared chat. "lets you share the chat with the custom instructions hidden"