Why not? The actual work that language models do is to complete the conversation. It doesn’t actually answer questions, it just tries to make the text look real.