New York City is composed of five boroughs: The Bronx, Brooklyn, Manhattan, Queens, and Staten Island. Each borough is coextensive with a respective county of New York State.
I think what he means is that Manhattan alone does not comprise the entire city.