I'm not familiar with Vimium, but Vimperator for Firefox will stop responding to everything when you press the "insert" key. There might be something equivalent for your plugin.

It worked for me when I typed an i to get Vimium into its insert mode. Although that is getting a little ridiculous.