It's not necessarily only window units. Many apartments have in-wall units also. It would be cost prohibitive for most to close up a hole in a brick wall to install a split unit.
In any case, almost nobody in NYC uses the sort of split system so common everywhere else. Older buildings are left with window units, while new buildings have built-in units, often with the most horrible control panels you can imagine from some dudes in New Jersey.