I believe that going to college is worth it if you're being selectively taught by the top 1%. The rest of the 99%? Forget about it-- you can learn more with an internet connection.
I think if you can get into a Carnegie Melon or Harvard then you should definitely attend, but there are over 2500 universities in the US. I, like many others, did not have any direction in high school and ended up attending a local state school where most of the professors were grad students more preoccupied with their own course load than with their students being able to understand the material.
Lower ranked ones tend to be teaching focussed.
Not all of us are as fortunate as you are.