The social skills, networks, and alumni connections you build at college are a large fraction of the benefit that college gives the average person to further their career.
Otherwise, I agree. College is a great time to take advantage of the time you have to change your network, generate new ideas and take risks. And I also agree that most there can be benefit (though highly unlikely) for some people to not attend college or to drop out.