I'm with spodek here - I also live near the Union Square Farmer's Market and it's a terrific resource.
Sometimes I'm feeling like something specific for dinner that may not be in season - and thanks to modern agriculture I can still go to the supermarket and get the ingredients. That's definitely not a need that the farmer's markets can fulfill.
But you absolutely can cook very reasonable dinners with the seasonal ingredients you get at the farmer's markets, and I enjoy doing so frequently. Doing this repeatably and reliably for dinner requires a wider breadth of recipes, but IMO is a skill well worth cultivating for not just nutrition but taste.
Personally, the changing of food with the seasons is IMO one of the great joys of life.
It feels like you're talking past the others in the thread here - many of whom can and do rely on CSAs and farmer's markets for their everyday cooking (and not just "fun treats"). Nobody's saying you must not use supermarkets (I sure do), or that CSAs/farmer's markets are the only way to go, but they are fairly complete sources of ingredients for meals.