If you give away the land to someone else, but still own the building on it, the person you gave the land to would have to pay land value tax and they would pass that onto you in rent.
Who would pay money for an asset with zero returns at all (or indeed negative returns due to a bunch of administrative costs)
Neither does the market, btw.