"The City" is to London as "Wall Street" is to New York. It's a term for one specific geographical part of the city which historically was a centre of the financial industry, and is now used to refer to the financial industry in general.

It variously means London, The City of London (which is a district inside London with an unusual political status), or the host of financial and trading services industries which in the UK are largely based in the City of London.