I've got the same issue with all the Linux distros I've seen. There might be some way of fixing it... but I just end up almost never using a GUI.