NYC is not as expensive as people make it out to be but it IS expensive. It's not just rent, though that's quite a bit of it; it's also the price of food and entertainment. I'm not saying that there isn't a ton of bargains out there but it takes work to find the fun and cheap things to do in the city.
I love it here but you have to be ready to make compromises if you want to live in the city.