GPT-3.5 and GPT-4 have special <|im_start|> and <|im_end|> tokens that are used for this purpose. (and if you try to send a message containing those strings to ChatGPT they get filtered out)