If you were comparing gasoline in a car to an EV I would maybe see what you are talking about- engines are like 30% efficient so the conversion to useful energy requires a large multiple of potential energy.

But in the case of an oil- or gas- fired furnace, their thermal efficiency is at least 80%, and often more, so their potential energy usage is close enough to directly comparable to their heating value.