I do expect a reboot to require somehow reloading my settings via xmodmap. More troubling is during an X session with Unity, my settings would be reverted, and I'd have to reload with xmodmap. Other desktop environments didn't have this issue. I really should have done my part and written a bug report.