When I debug gui/gtk2 programs, gdb manages to sometimes freeze my entire desktop

I have to kill gdb from outside the X server to do anything else