What makes it "a tax haven in its own right"? Is it subject to different taxation than the rest of London or the UK?
What the "city" may well get is favourable interpretation of complex ambiguous tax arrangements. That's the argument against e.g. Vodafone. What the "city" is afraid of is changes in EU law that seem highly technical but have the effect of damaging its business. The Tobin tax is one example.
(London in general benefits from the stupid way property tax is done in the UK with finite "bands", so a family house and a multistorey mansion pay the same annual tax, but that's a separate issue.)