Let's be clear about what G&T programs mean in NYC. There is a heavier workload and more intensive academic focus but not really so much in terms of constructivist learning, child autonomy etc... That why we skipped it. To be blunt, I wanted my kids to have a more interesting classroom experience and not waste evenings stuck doing homework when they were little. My bet/assessment was that they would be smart enough to more than catch up later on when the workload ramps in a challenging middle school. So far it looks like I was right.
BTW - not all public school in NYC is tough. You have to remember the scale of NYC. Within it are insanely great schools, a lot of mediocre schools, and too many horror shows - much like the public school system in any US state.