It's quite simple to disable Vimimum for a website, just click the extension icon and "Save Changes". By default it will add a rule to disable all keys on that site.