Brexit is bad for me personally, but I'm sure that respecting results of a political procedures (referenda, elections) is exactly what should be done in a democracy, because not sticking to rules of the game is a direct way to destroy trust, and incentive to vote. "Diminishing support" is what often happens to very freshly elected MPs, governments, or presidents, and it doesn't cancel electoral outcomes.