Are we entirely sure that energy and information aren't the same thing, or if they aren't the same thing they are both highly overlapping echoes of some more fundamental concept? Or maybe they are two sides of the same coin?
Information is physical. It is inextricably tied to the physical degrees of freedom of the system storing it. Per Landauer's Principle, erasing information is an irreversible process that increases the entropy of the environment, and this increase in entropy is the dissipation of energy. With that in mind, I would argue that you are correct, energy and information are in fact two sides of the same coin.