Having this problem with the voice mode as well. It makes it far less usable than it might be if it just honored the system prompts.