I worked around this issue using xcape to map my Super key to another key combo:

  xcape -e "Super_L=Alt_L|F1"

Then set the keyboard shortcut for xfce4-popup-whiskermenu to the new combo (Alt+F1 in this case). This allows other Super shortcuts to work without triggering whiskermenu.