I agree this is annoying, but you can always Exit the program from the icon in the menubar (works for me on both GNOME and xfce).