For me it's the schools. I have 3 kids and they all go to public schools in Manhattan. NYC has some very good public schools. Maybe not as good as the best private schools, but hey, you save 50-60k per year.

Among elementary, middle and high schools, the best deal you get with the high schools. NYC has a system of specialized high schools where the admission is based on an exam. Some elementary schools are great. You can research that ahead of time and restrict the area you are looking to move to. Of course, the rents or home prices are higher in the districts with great schools.

Middle schools, that's a bit of a problem. The admission is currently based on lottery. Quite a number of middle schools used to have exam-based admission, but now it's all lottery. Hoping for this to change in the future.

If I didn't have to worry about schools, I'd choose Jersey City any day.