Or a more sinister reason: canonically, magic is powered by sacrifice - and most powerfully, human sacrifice. Sure, Tolkien skips over the child-snatchers, the sacrificial altars, the charnel-pits behind the Valar-temples, but we well know the true cost of the Numenorean theocracy.