I had this problem and the solution was to use the game's `f` keybinding for fullscreen instead. Or open the game in a separate window, because ALT-F4 is the only way to close it.