I find that Copilot's suggestions are not quite what I want in most cases, so I have to edit what they give me anyway.
I know Primagen had a similar experience that you had, he found it useful to keep the AI chat out of his direct editor, and that's how I've been using it too.