I’m not sure where the context comes from. Once it writes <|endoftext|> it interrupts the message and replies to itself with a completely random reply

It certainly seems like it.