In aerospace engineering, they are used in just a few circumstances to augment the active heaters in a spacecraft: Heater lines, which are resistive heaters in a foil with a PI controller. You need active thermal control since your environment changes a lot (launch, preliminary orbit, transit, orbit) and thus its thermal parameters (some parts of a spacecraft may experience temperature gradients of a few hundred Kelvin within a few minuts). Most spacecraft designs have issues with overheating and thus RHUs cannot be used here.
An RTG's primary objective is to produce electrical energy (at an abysmal efficiency). The excess heat generated by an RTG is seldomly used for thermal control since it can also not be regulated and it emits simply too much heat energy.