How efficiently do GPUs heat? I'm assuming most of the input energy is lost to heat?
If you take into account transport loss and efficiency of creating the electric current, then it's probably below 50%.
Heat pumps typically have an efficiency of 300% (COP 3) because they pump heat from outside to the inside. (inverse of how a refrigerator works).