Also, keep in mind that school is intended to teach you more than just history, math, etc. This is also where we learn to socialize. I guarantee you that my introverted self wouldn't have kissed a girl as early as I did if I wasn't forced to socialize with people for 170 school days a year. I learned how to make friends and how to balance my need for solitude with deeply fulfilling relationships -- something that would have taken much longer has I not been in school.
This isn't to say that my experience is biased towards the upper end of the achievement gap. In fact, while I'm in grad school in Boston, I'm volunteering at a charter school in its inner city and trust me, there are many problems with inner city education but the least of which is standardized testing. Traumatic home lives, poor materials, no cultural understanding of the value of education, etc represent far larger hurdles.
Indeed, I believe we should quibble about the standards and have a national discussion about what an educated member of society should know instead of debating the value of a standard at all. I believe that these standard have gone too far (plumbers probably don't need calculus, for example) but having a base-line of education is never a bad thing.